-- Logs begin at Sat 2022-10-22 20:01:23 UTC, end at Sat 2022-10-22 20:56:49 UTC. -- Oct 22 20:30:11.401137 dv-osbrick-master-4-ceph systemd[1]: Starting Devstack devstack@keystone.service... Oct 22 20:30:11.411295 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Oct 22 20:30:11 2022] *** Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: nodename: dv-osbrick-master-4-ceph Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: machine: x86_64 Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: clock source: unix Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: pcre jit disabled Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: detected number of CPU cores: 4 Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: current working directory: / Oct 22 20:30:11.413232 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: detected binary path: /usr/bin/uwsgi-core Oct 22 20:30:11.413762 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: your processes number limit is 47680 Oct 22 20:30:11.413762 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: your memory page size is 4096 bytes Oct 22 20:30:11.413762 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: detected max file descriptor number: 2048 Oct 22 20:30:11.413762 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: lock engine: pthread robust mutexes Oct 22 20:30:11.413762 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: thunder lock: enabled Oct 22 20:30:11.413762 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Oct 22 20:30:11.413762 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 22 20:30:11.456981 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: Python main interpreter initialized at 0x55a7e67a49c0 Oct 22 20:30:11.456981 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: python threads support enabled Oct 22 20:30:11.456981 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: your server socket listen backlog is limited to 100 connections Oct 22 20:30:11.456981 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: your mercy for graceful operations on workers is 90 seconds Oct 22 20:30:11.457308 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: mapped 403077 bytes (393 KB) for 2 cores Oct 22 20:30:11.457369 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: *** Operational MODE: preforking *** Oct 22 20:30:11.457652 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: *** uWSGI is running in multiple interpreter mode *** Oct 22 20:30:11.457652 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: spawned uWSGI master process (pid: 88368) Oct 22 20:30:11.457825 dv-osbrick-master-4-ceph systemd[1]: Started Devstack devstack@keystone.service. Oct 22 20:30:11.462209 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: spawned uWSGI worker 1 (pid: 88407, cores: 1) Oct 22 20:30:11.462209 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: spawned uWSGI worker 2 (pid: 88408, cores: 1) Oct 22 20:30:11.462209 dv-osbrick-master-4-ceph devstack@keystone.service[88368]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 22 20:30:16.006807 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:30:16.006807 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: from cryptography.utils import int_from_bytes Oct 22 20:30:16.007811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:30:16.007811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: from cryptography.utils import int_from_bytes Oct 22 20:30:16.008219 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:30:16.008219 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: from cryptography.utils import int_from_bytes Oct 22 20:30:16.008331 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 22 20:30:16.008331 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: from cryptography.utils import int_from_bytes Oct 22 20:30:16.056459 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 20:30:16.056668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 22 20:30:16.056750 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 20:30:16.056828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 22 20:30:16.056893 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] command line args: [] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 20:30:16.056953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] command line args: [] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 22 20:30:16.057076 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 20:30:16.057203 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 22 20:30:16.057278 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ================================================================================ {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 20:30:16.057340 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ================================================================================ {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 22 20:30:16.057532 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] admin_token = **** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.057664 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] admin_token = **** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.057745 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] config_dir = [] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.057810 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] config_dir = [] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.057868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.057930 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058000 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] config_source = [] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058064 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] config_source = [] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058201 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] debug = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058326 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] debug = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058410 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058680 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058775 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058835 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058892 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.058959 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] insecure_debug = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.059104 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.059184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.059403 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.059533 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.059606 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] list_limit = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.059680 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] list_limit = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.059745 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] log_config_append = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.059803 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] log_config_append = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.059950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060036 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] log_dir = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060171 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] log_dir = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060230 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] log_file = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060287 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] log_file = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060492 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060607 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060682 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.060922 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061016 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061234 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061388 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061545 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061631 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061775 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061849 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.061929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.062001 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.062193 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.062320 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.062395 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.062460 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.062600 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.062678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.062849 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.062979 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.063112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.063187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.063293 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.063367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] notification_format = cadf {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.063583 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.063758 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.064058 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.064196 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.064337 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] publish_errors = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.064453 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] publish_errors = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.064573 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.064690 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.064800 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.064914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.065024 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.065138 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.065257 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.065384 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.065501 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.065610 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.065727 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] standard_threads = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.065845 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] standard_threads = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.065959 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.066074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] strict_password_check = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.066189 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.066306 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.066471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.066590 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] use_eventlog = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.066706 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] use_journal = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.066825 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] use_journal = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.066940 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] use_json = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.067049 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] use_json = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.067166 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] use_stderr = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.067306 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] use_stderr = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.067431 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] use_syslog = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.067554 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] use_syslog = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.067666 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.067780 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] watch_log_file = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 22 20:30:16.067901 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.067996 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068573 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068666 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068763 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068856 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.068948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069046 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069266 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069338 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069408 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069483 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069558 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069627 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069695 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069763 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069907 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.069982 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.070056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.070207 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.070327 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.070403 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.070491 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.070682 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.070803 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.070890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.070962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.071161 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.071398 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.071398 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.071551 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.071623 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.071700 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.071880 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.072028 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.072114 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.072185 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.072364 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.072496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.072576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.072657 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.072790 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.072910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.073021 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.073234 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.073359 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.073470 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.073588 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.073699 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.073807 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.073916 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.074035 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.074146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.074264 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.074376 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.074484 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.074592 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.074709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.074819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.074928 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.075036 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.075144 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.075252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.075438 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.075551 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.075666 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.075778 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.075886 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.075994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.076112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.076229 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.076344 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.076453 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.076562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.076670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.076855 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.076968 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.077077 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.077186 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.077295 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.077403 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.077525 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.077636 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.077745 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.077854 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.077963 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.078073 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.078189 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.078299 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.078407 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.078515 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.078629 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.078738 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.078857 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.078967 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.079076 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.079184 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.079306 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.079416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.079537 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.079648 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.079756 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.079865 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.080005 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.080124 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.080243 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.080359 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.080469 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.080584 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.080694 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.080812 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.080922 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.081033 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.081142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.081257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.081367 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.081488 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.081606 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.081723 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.081841 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.081959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.082089 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.082270 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.082385 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.082494 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.082611 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.082722 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.082837 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.082948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.083059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.083176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.083330 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.083443 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.083587 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.083700 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.083810 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.083810 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.084130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.084250 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.084361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.084470 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.084579 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.084697 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.084808 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.084917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.085028 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.enabled = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.085144 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.085255 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.085377 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.085488 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.085598 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.085709 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.085824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.085941 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.086059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.086170 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.086286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.086397 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.086506 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.086615 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.086732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.086842 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.086952 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.087061 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.087169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.087293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.087418 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.087530 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.087646 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.087756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.087866 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.087975 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.088158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.088277 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.088388 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.088497 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.088607 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.088716 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.088834 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.088952 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.089081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.089193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.089303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.089412 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.089524 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.089633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.089750 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.089861 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.089970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.090079 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.090197 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.090308 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.090426 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.090537 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.090647 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.090756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.090865 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.090981 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.091092 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.091201 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.091344 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.091456 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.091565 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.091686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.091798 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] auth.external = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.091934 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.092057 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.092172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.092283 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.092394 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] auth.external = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.092510 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.092629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] auth.mapped = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.092741 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] auth.password = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.092851 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.092961 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] auth.token = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.093071 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.093181 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.093299 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] auth.password = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.093410 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.093520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] auth.token = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.093630 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.093740 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.093850 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.093967 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] catalog.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.094078 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.094189 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.094298 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.094408 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.094518 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.094636 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.094748 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] credential.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.094857 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.094967 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.095076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.095186 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.095322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] credential.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.095435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.095552 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] credential.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.095664 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.095774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.095884 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.096001 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.096112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.096221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.096336 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.096447 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.096557 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.096676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.096787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.096915 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.097027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.097137 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.097247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.097365 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.097481 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.097601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.097713 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.097713 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.097925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.098043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.098155 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.098264 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] federation.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.098373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.098490 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.098601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.098718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.098830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.098940 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.099050 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] federation.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.099159 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.099314 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.099439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.099552 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] federation.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.099662 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.099839 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.099950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.100069 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.100189 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.100301 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.100411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.100521 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.100631 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.100742 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.100864 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.100978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101088 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101242 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101389 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101540 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101611 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101681 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101749 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101826 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.101945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102002 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102058 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102115 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102182 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102243 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102301 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102357 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102414 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102470 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102591 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102661 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.102924 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.103013 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.103084 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.103154 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.103344 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.103418 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.103586 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.103653 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.103834 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.103901 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.104073 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.104149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.104333 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.104400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.104657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.104743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.104823 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.104894 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.105016 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.105094 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.105562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.105645 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.105787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.105865 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.106054 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.106165 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.106251 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.106318 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.106482 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.106550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.106717 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.106825 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.106930 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.107025 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.107218 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.107501 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.107501 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.107832 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.107832 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.108193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.108193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.108548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.108548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.108896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.109080 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.109260 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.109464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.109652 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.109839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.110025 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.110209 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.110395 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.110586 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.110767 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.110951 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.111137 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.111344 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.111534 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.password = **** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.111738 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.111921 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.112101 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.112282 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.112469 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.112654 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.112853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.113038 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.113224 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.113411 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.113600 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.113784 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.113979 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.114162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.114350 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.114537 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.114722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.114906 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.115105 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.115327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.115507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.115686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.115870 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.116036 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.116153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.116265 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.116375 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.116512 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.116698 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.116895 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.117032 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.117146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.117258 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.117369 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.117480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.117599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.117716 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.117826 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.117937 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.118047 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.118157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.118275 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.118387 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.118498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.118610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.118722 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.118833 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.118951 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.119064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.119174 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.119307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.119421 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.119543 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.119664 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.119777 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.119887 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.119997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.120107 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.120217 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.120334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.120446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.120556 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.120667 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.120776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.120776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.120992 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.121103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.121214 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.121324 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.121433 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.121543 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.121661 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.121772 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.121883 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.121993 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.122103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.122212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.122329 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.122441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.122557 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.122668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.122779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.122890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] policy.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.123009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.123120 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.123231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.123388 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.123499 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.123612 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.123734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.123846 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] receipt.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.123958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.124162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.124275 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.124385 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.124503 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] resource.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.124616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.124727 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.124837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.124947 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.125059 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.125177 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.125290 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] resource.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.125401 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.125511 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.125622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.125731 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] resource.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.125849 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.125961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.126073 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.126183 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.126294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.126294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.126577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.126692 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] role.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.126802 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] revoke.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.126913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] role.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.127023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.127134 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.127252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.127386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.127497 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] role.cache_time = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.127608 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.127718 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] role.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.127829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.127951 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] role.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.128064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.128176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] role.list_limit = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.128286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.128396 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.128514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.128626 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.128737 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.128847 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.128957 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.129067 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.129186 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.129298 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.129409 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.129518 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.129628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.129738 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.129856 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.129968 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.130078 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.130188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.130188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.130395 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.130513 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.130624 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.130734 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.130844 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.130994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.131117 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.131117 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.131382 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.131495 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.131605 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.131716 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.131826 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.131950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.132063 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.132173 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.132291 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.132404 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.132514 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.132631 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.132743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.132853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.132963 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.133073 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.133193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.133305 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.133416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.133530 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.133641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.133751 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.133868 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.133980 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.134090 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.134200 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.134310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.134421 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.134541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.134653 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] token.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.134764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.134881 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.134993 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.135103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.135221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.135347 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.135457 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] token.cache_time = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.135568 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.135678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] token.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.135788 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.135914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.136028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.136138 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] token.provider = fernet {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.136248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.136358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.136468 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.136588 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.136700 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.136810 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.136920 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.137030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.137140 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.137258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.137370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.137480 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.137592 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.137702 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] trust.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.137813 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.137930 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138042 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138161 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138503 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138615 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.connection = **** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138843 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138955 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.138955 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.139162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.139314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.139436 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.139549 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.139710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.139825 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.139936 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.connection = **** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.140047 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.140157 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.140267 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.140385 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.140498 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.140609 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.140785 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.140896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.141007 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.141129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.141241 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.141241 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.141448 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.141558 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.141668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.141787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.141905 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.142016 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.142126 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.142236 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.142345 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.142463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.142574 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.142684 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.142794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.142905 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88408) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 20:30:16.143015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.143015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.143015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.143015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.143015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.143015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 22 20:30:16.143015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=88407) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 22 20:30:16.168038 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.168263 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.168350 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.168490 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.168574 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.168786 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.176944 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.177236 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.204448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.204715 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.204991 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.205221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.257190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.257437 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.306125 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.306317 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.306995 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.307225 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.370883 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371056 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371222 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371320 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371462 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371601 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371681 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371764 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371839 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.371900 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.372030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395222 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395375 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395468 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395590 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395666 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395733 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395803 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395882 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.395954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.396014 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.396128 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.396128 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.406846 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.407323 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.419511 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.419775 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.419896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420031 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420253 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420391 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420504 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420590 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420707 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420782 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88408) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.420896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.421008 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=88407) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Oct 22 20:30:16.437323 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.437526 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 22 20:30:16.437648 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.437775 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 22 20:30:16.437855 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.438040 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 22 20:30:16.438181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.438317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Oct 22 20:30:16.438391 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.438509 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.438596 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.438777 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.438899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.439034 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.439113 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.439293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.448448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.448718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.448839 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.448975 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.449054 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.449244 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.449381 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.449517 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.456134 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.456463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.458972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.459294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.459482 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.459575 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.459701 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.459781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.459899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.460086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.460220 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.460298 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.460418 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.460553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.460757 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.460884 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.461020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.461140 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.461262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.461376 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.461517 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.461650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.461773 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.462000 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.484302 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.484908 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.485736 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.486013 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.486383 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.486664 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.490566 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.490842 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.491246 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.491552 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.492717 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.493445 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.499017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.499291 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.499838 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.500123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.503205 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.503509 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.503782 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.504090 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.504213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.504343 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.504438 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.504640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.504763 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.504889 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.505007 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.505175 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.505312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.505560 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.505834 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.506147 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.521004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.521237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.521745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.522023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.525147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.526467 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.528258 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.528640 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.529648 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.530083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.532942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.534373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.536060 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.537529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.539171 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.539495 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.539772 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.540160 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.540431 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.540644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.540732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.540946 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.541230 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.541620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.541884 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.542183 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.556838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.557119 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.557385 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.557640 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.558489 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.558775 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.559011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.559293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.564322 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.565958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.566084 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.567494 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.567689 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.567786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.569314 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.569587 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.570406 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.570695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.570970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.571198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.571531 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.572239 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.572537 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.572820 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.573110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.573395 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.582723 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.582994 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.583291 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.583564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.583847 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.584161 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.584434 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.584798 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.585080 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.585363 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.585640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.585918 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.586177 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.586451 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.599646 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.601857 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.602638 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.604918 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.605855 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.607276 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.608130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.608717 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.608962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.609271 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.609563 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.611037 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.611311 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.611611 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.615715 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.617173 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.618188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.619676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.620023 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.620303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.620580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.620843 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.622539 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.622831 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.623120 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.623420 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.628733 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.629065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.629301 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.631615 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.631909 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.632192 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.637055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88408) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.637328 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.637599 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.637867 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.638131 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.638409 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.638678 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.638937 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.639211 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.639504 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.639769 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.639967 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=88407) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Oct 22 20:30:16.640079 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.640259 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.640344 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.640524 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88408) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.640742 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.640742 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.641033 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.641325 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.641607 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.641872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.642164 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.642431 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.642716 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.642989 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.643250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.643527 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=88407) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Oct 22 20:30:16.673158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7e67a49c0 pid: 88408 (default app) Oct 22 20:30:16.676409 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55a7e67a49c0 pid: 88407 (default app) Oct 22 20:30:16.676617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec077d-271d-43d6-94b5-077abffb7031 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:16.676896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec077d-271d-43d6-94b5-077abffb7031 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:16.677162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fec077d-271d-43d6-94b5-077abffb7031 None None] PATH_INFO: `/v3` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:16.681376 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Sat Oct 22 20:30:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:23.935701 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d90e0c-061b-486d-8d6c-bf4e83d4e6a9 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:23.936522 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d90e0c-061b-486d-8d6c-bf4e83d4e6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:23.936522 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d90e0c-061b-486d-8d6c-bf4e83d4e6a9 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:23.943708 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:23 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:23.949082 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:23.949637 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:23.949637 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:24.028433 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: INFO dbcounter [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] Registered counter for database keystone Oct 22 20:30:24.049770 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG oslo_db.sqlalchemy.engines [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88408) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:30:24.060140 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writer thread running {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:30:24.248919 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG passlib.handlers.bcrypt [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88408) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 22 20:30:24.249219 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG passlib.handlers.bcrypt [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88408) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 22 20:30:24.308583 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:24.310174 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:24.448189 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 500 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 20:30:24.970385 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d90e0c-061b-486d-8d6c-bf4e83d4e6a9 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:25.046094 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: INFO dbcounter [None req-d6d90e0c-061b-486d-8d6c-bf4e83d4e6a9 None None] Registered counter for database keystone Oct 22 20:30:25.070992 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG oslo_db.sqlalchemy.engines [None req-d6d90e0c-061b-486d-8d6c-bf4e83d4e6a9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=88407) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:326}} Oct 22 20:30:25.082397 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writer thread running {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 22 20:30:25.198873 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d90e0c-061b-486d-8d6c-bf4e83d4e6a9 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:25.204394 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72dc0d4b-f199-4e72-9d4b-dc3f3d9e7821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:25.205022 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc0d4b-f199-4e72-9d4b-dc3f3d9e7821 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:25.205295 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc0d4b-f199-4e72-9d4b-dc3f3d9e7821 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:25.205561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72dc0d4b-f199-4e72-9d4b-dc3f3d9e7821 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:25.214689 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc0d4b-f199-4e72-9d4b-dc3f3d9e7821 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:25.265871 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WARNING keystone.common.rbac_enforcer.enforcer [None req-72dc0d4b-f199-4e72-9d4b-dc3f3d9e7821 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 22 20:30:25.266159 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72dc0d4b-f199-4e72-9d4b-dc3f3d9e7821 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:25.276704 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Sat Oct 22 20:30:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Oct 22 20:30:25.283741 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:25.304812 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1939ef4c-9a57-4f58-941e-7813a79f7567 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:25.311206 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22af63bb-3ab6-4da9-a262-583791fd766f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:25.312346 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af63bb-3ab6-4da9-a262-583791fd766f admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:25.312624 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af63bb-3ab6-4da9-a262-583791fd766f admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:25.312893 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22af63bb-3ab6-4da9-a262-583791fd766f admin admin] PATH_INFO: `/v3/projects/9729266775c4452a92f26be4932200ad` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:25.316892 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af63bb-3ab6-4da9-a262-583791fd766f admin admin] RBAC: Authorizing `identity:get_project(project_id=9729266775c4452a92f26be4932200ad)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:25.367743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING keystone.common.rbac_enforcer.enforcer [None req-22af63bb-3ab6-4da9-a262-583791fd766f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Oct 22 20:30:25.368080 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22af63bb-3ab6-4da9-a262-583791fd766f admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:25.372678 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Sat Oct 22 20:30:25 2022] GET /identity/v3/projects/9729266775c4452a92f26be4932200ad => generated 344 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:27.716098 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04df2-9473-4a09-ad05-da781bf6efff None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:27.716699 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04df2-9473-4a09-ad05-da781bf6efff None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:27.716699 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf04df2-9473-4a09-ad05-da781bf6efff None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:27.720748 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:27.727468 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8b44a-cc14-4fbb-95d2-1da7da68c88f None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:27.728204 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8b44a-cc14-4fbb-95d2-1da7da68c88f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:27.728335 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8b44a-cc14-4fbb-95d2-1da7da68c88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:27.754332 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-a6a8b44a-cc14-4fbb-95d2-1da7da68c88f None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:27.755902 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-a6a8b44a-cc14-4fbb-95d2-1da7da68c88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:27.765292 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 20:30:28.078825 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04df2-9473-4a09-ad05-da781bf6efff None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:28.093010 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf04df2-9473-4a09-ad05-da781bf6efff None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:28.098364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4396f2ed-e241-41c7-929a-a30a64a2efc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:28.098964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f2ed-e241-41c7-929a-a30a64a2efc9 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:28.099236 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f2ed-e241-41c7-929a-a30a64a2efc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:28.099601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4396f2ed-e241-41c7-929a-a30a64a2efc9 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:28.108787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396f2ed-e241-41c7-929a-a30a64a2efc9 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:28.110583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4396f2ed-e241-41c7-929a-a30a64a2efc9 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:28.119969 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Sat Oct 22 20:30:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Oct 22 20:30:28.125943 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8b44a-cc14-4fbb-95d2-1da7da68c88f None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:28.136442 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8b44a-cc14-4fbb-95d2-1da7da68c88f None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:28.142258 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a337d770-ab60-413d-b912-63c6bd33dfcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:28.142884 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337d770-ab60-413d-b912-63c6bd33dfcc admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:28.143164 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337d770-ab60-413d-b912-63c6bd33dfcc admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:28.143474 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a337d770-ab60-413d-b912-63c6bd33dfcc admin admin] PATH_INFO: `/v3/users/f2fce337ce4a417ea9044d0fbc87d49f` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:28.144931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337d770-ab60-413d-b912-63c6bd33dfcc admin admin] RBAC: Authorizing `identity:get_user(user_id=f2fce337ce4a417ea9044d0fbc87d49f)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:28.146781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a337d770-ab60-413d-b912-63c6bd33dfcc admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:28.148307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Sat Oct 22 20:30:28 2022] GET /identity/v3/users/f2fce337ce4a417ea9044d0fbc87d49f => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:30.542654 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694463-61ba-4d20-9c70-bfa147b85a18 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:30.543209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694463-61ba-4d20-9c70-bfa147b85a18 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:30.543209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3694463-61ba-4d20-9c70-bfa147b85a18 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:30.544556 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:30.549975 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df82236-4f7b-4515-95a1-e7fad41ca640 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:30.550423 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df82236-4f7b-4515-95a1-e7fad41ca640 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:30.550513 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df82236-4f7b-4515-95a1-e7fad41ca640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:30.568800 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-4df82236-4f7b-4515-95a1-e7fad41ca640 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:30.570074 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-4df82236-4f7b-4515-95a1-e7fad41ca640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:30.621359 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371ff3a-a1dd-4b54-a08b-ef950dc24631 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:30.621626 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371ff3a-a1dd-4b54-a08b-ef950dc24631 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:30.621916 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c371ff3a-a1dd-4b54-a08b-ef950dc24631 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:30.623216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:30.628509 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d135da-f790-42e6-90ca-a716f149fae7 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:30.628791 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d135da-f790-42e6-90ca-a716f149fae7 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:30.629060 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d135da-f790-42e6-90ca-a716f149fae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:30.653829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:30.670845 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG passlib.handlers.bcrypt [None req-75d135da-f790-42e6-90ca-a716f149fae7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=88407) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Oct 22 20:30:30.671241 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG passlib.handlers.bcrypt [None req-75d135da-f790-42e6-90ca-a716f149fae7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=88407) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Oct 22 20:30:30.719485 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-75d135da-f790-42e6-90ca-a716f149fae7 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:30.721013 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-75d135da-f790-42e6-90ca-a716f149fae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:30.824794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:30:30.973359 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df82236-4f7b-4515-95a1-e7fad41ca640 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:31.114056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:31.142460 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d135da-f790-42e6-90ca-a716f149fae7 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:31.205600 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df82236-4f7b-4515-95a1-e7fad41ca640 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:31.244138 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c8849-0a37-44d3-a684-5fe4e3993c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:31.245037 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c8849-0a37-44d3-a684-5fe4e3993c6d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:31.245315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c8849-0a37-44d3-a684-5fe4e3993c6d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:31.245586 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62c8849-0a37-44d3-a684-5fe4e3993c6d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:31.249791 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d135da-f790-42e6-90ca-a716f149fae7 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:31.252154 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:31.258720 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62c8849-0a37-44d3-a684-5fe4e3993c6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-d62c8849-0a37-44d3-a684-5fe4e3993c6d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:31.271480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:31.272448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:30:31.273321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:30:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:31.278848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c8849-0a37-44d3-a684-5fe4e3993c6d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:31.292495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:31.293378 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:31.293650 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:31.293906 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:31.294875 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:31.296371 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:31.307865 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.sql.core [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 20:30:31.307865 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 20:30:31.307865 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [parameters: {'id': 'ffa09dc9298c4d25912ac708ad111a54', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 22 20:30:31.307865 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88407) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application conn.query(q) Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:30:31.327633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application result.read() Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 22 20:30:31.328675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application next(self.gen) Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application yield resource Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application next(self.gen) Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.session.rollback() Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.force_reraise() Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise self.value Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application session.commit() Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 22 20:30:31.329711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._prepare_impl() Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.session.flush() Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._flush(objects) Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application compat.raise_( Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application flush_context.execute() Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rec.execute(self) Oct 22 20:30:31.330706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 20:30:31.331756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application conn.query(q) Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application result.read() Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 20:30:31.332565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [parameters: {'id': 'ffa09dc9298c4d25912ac708ad111a54', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 22 20:30:31.333344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:31.334240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:31.335176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 8/15] 10.222.0.39 () {60 vars in 1137 bytes} [Sat Oct 22 20:30:31 2022] POST /identity/v3/domains => generated 190 bytes in 187 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:30:31.336193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:31.366627 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:31.386265 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62c8849-0a37-44d3-a684-5fe4e3993c6d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:31.423219 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e69c1-fc0d-4b75-bd7e-aa32a3fe087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:31.423864 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e69c1-fc0d-4b75-bd7e-aa32a3fe087d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:31.424142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e69c1-fc0d-4b75-bd7e-aa32a3fe087d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:31.424418 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55e69c1-fc0d-4b75-bd7e-aa32a3fe087d None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:31.425085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e69c1-fc0d-4b75-bd7e-aa32a3fe087d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:31.425387 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e69c1-fc0d-4b75-bd7e-aa32a3fe087d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:31.426791 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55e69c1-fc0d-4b75-bd7e-aa32a3fe087d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:31.438667 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 8/16] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:30:31.444367 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e69c1-fc0d-4b75-bd7e-aa32a3fe087d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:31.445547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c0135-922c-4d73-9f3e-2742e192edb1 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:31.479899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9313a3-0bce-4d0b-982b-eecebdbf581a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:31.482082 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9313a3-0bce-4d0b-982b-eecebdbf581a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:31.482371 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9313a3-0bce-4d0b-982b-eecebdbf581a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:31.482643 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9313a3-0bce-4d0b-982b-eecebdbf581a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:31.500632 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9313a3-0bce-4d0b-982b-eecebdbf581a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:31.502228 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9313a3-0bce-4d0b-982b-eecebdbf581a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-da9313a3-0bce-4d0b-982b-eecebdbf581a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:30:31.522988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:31.524045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:30:31.524886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:30:31.524886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:30:31.524886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:31.525557 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:31.531530 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9313a3-0bce-4d0b-982b-eecebdbf581a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:31.554179 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55e69c1-fc0d-4b75-bd7e-aa32a3fe087d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:31.592233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f0ce0-7d05-4806-98cf-17d00ec621b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:31.592875 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f0ce0-7d05-4806-98cf-17d00ec621b9 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:31.593146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f0ce0-7d05-4806-98cf-17d00ec621b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:31.593411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f0ce0-7d05-4806-98cf-17d00ec621b9 None admin] PATH_INFO: `/v3/users/f2fce337ce4a417ea9044d0fbc87d49f` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:31.594640 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f0ce0-7d05-4806-98cf-17d00ec621b9 None admin] RBAC: Authorizing `identity:get_user(user_id=f2fce337ce4a417ea9044d0fbc87d49f)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:31.596169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f0ce0-7d05-4806-98cf-17d00ec621b9 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:31.597792 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:31 2022] GET /identity/v3/users/f2fce337ce4a417ea9044d0fbc87d49f => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:31.603608 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f0ce0-7d05-4806-98cf-17d00ec621b9 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:31.621029 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:31.669163 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:31.713758 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f0ce0-7d05-4806-98cf-17d00ec621b9 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:31.747673 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b90e4-bdd6-4c76-803f-b32d637a96a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:31.748294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b90e4-bdd6-4c76-803f-b32d637a96a0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:31.748567 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b90e4-bdd6-4c76-803f-b32d637a96a0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:31.748833 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7b90e4-bdd6-4c76-803f-b32d637a96a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:31.749954 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b90e4-bdd6-4c76-803f-b32d637a96a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:31.751498 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7b90e4-bdd6-4c76-803f-b32d637a96a0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:31.752728 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9313a3-0bce-4d0b-982b-eecebdbf581a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:31.752975 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:30:31.758582 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b90e4-bdd6-4c76-803f-b32d637a96a0 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:31.786089 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85775cb4-de38-4475-a5ef-685023994bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:31.786717 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775cb4-de38-4475-a5ef-685023994bc0 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:31.786988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775cb4-de38-4475-a5ef-685023994bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:31.787283 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85775cb4-de38-4475-a5ef-685023994bc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:31.787921 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85775cb4-de38-4475-a5ef-685023994bc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:31.788216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85775cb4-de38-4475-a5ef-685023994bc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:31.789643 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85775cb4-de38-4475-a5ef-685023994bc0 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:31.806431 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:30:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:30:31.843346 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:31.866710 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7b90e4-bdd6-4c76-803f-b32d637a96a0 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:31.904378 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd8b5d-8973-4c9f-85dd-b26659680c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:31.905053 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8b5d-8973-4c9f-85dd-b26659680c7e None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:31.905332 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8b5d-8973-4c9f-85dd-b26659680c7e None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:31.905616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd8b5d-8973-4c9f-85dd-b26659680c7e None admin] PATH_INFO: `/v3/domains/default/users/f2fce337ce4a417ea9044d0fbc87d49f/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:31.907721 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd8b5d-8973-4c9f-85dd-b26659680c7e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f2fce337ce4a417ea9044d0fbc87d49f, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:31.909205 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acd8b5d-8973-4c9f-85dd-b26659680c7e None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:32.031999 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 11/21] 10.222.0.39 () {58 vars in 1361 bytes} [Sat Oct 22 20:30:31 2022] PUT /identity/v3/domains/default/users/f2fce337ce4a417ea9044d0fbc87d49f/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:30:34.735323 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f95c7-0b97-4311-a2cd-fc72be0d9821 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:34.735837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f95c7-0b97-4311-a2cd-fc72be0d9821 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:34.735837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f95c7-0b97-4311-a2cd-fc72be0d9821 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:34.737459 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:34.755284 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdd80b-d7bd-4ff2-b244-3c5896f53b48 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:34.755284 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdd80b-d7bd-4ff2-b244-3c5896f53b48 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:34.755284 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fdd80b-d7bd-4ff2-b244-3c5896f53b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:34.776818 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-83fdd80b-d7bd-4ff2-b244-3c5896f53b48 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:34.778611 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-83fdd80b-d7bd-4ff2-b244-3c5896f53b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:34.883361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:34.971342 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588852-3860-4f6b-8cfc-0c4b4a5a6076 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:34.971620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588852-3860-4f6b-8cfc-0c4b4a5a6076 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:34.972046 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34588852-3860-4f6b-8cfc-0c4b4a5a6076 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:34.973781 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:34.979251 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9139607-94d1-49e8-b9a6-a1a381d2ab0d None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:34.979761 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9139607-94d1-49e8-b9a6-a1a381d2ab0d None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:34.980494 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9139607-94d1-49e8-b9a6-a1a381d2ab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:34.998793 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-a9139607-94d1-49e8-b9a6-a1a381d2ab0d None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:35.000226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-a9139607-94d1-49e8-b9a6-a1a381d2ab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:35.064754 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9f1db-b055-481b-93a3-1633735a7e9b None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:35.065393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9f1db-b055-481b-93a3-1633735a7e9b None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:35.065849 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d9f1db-b055-481b-93a3-1633735a7e9b None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:35.067370 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 13/25] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:35.084260 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400f45-f57e-49fa-98a1-e4ee8dc3b0a1 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:35.084828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400f45-f57e-49fa-98a1-e4ee8dc3b0a1 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:35.085332 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9400f45-f57e-49fa-98a1-e4ee8dc3b0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:35.120778 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 13/26] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:35.121453 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:35.131503 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-c9400f45-f57e-49fa-98a1-e4ee8dc3b0a1 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:35.133017 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-c9400f45-f57e-49fa-98a1-e4ee8dc3b0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:35.155229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d09a1-5e98-4e73-97fa-600cc85e17fd None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:35.155811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d09a1-5e98-4e73-97fa-600cc85e17fd None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:35.156298 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d09a1-5e98-4e73-97fa-600cc85e17fd None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:35.162068 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:35.166457 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442a743-47b2-4f7b-9f48-02ff58f9639a None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:35.166954 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442a743-47b2-4f7b-9f48-02ff58f9639a None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:35.167520 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6442a743-47b2-4f7b-9f48-02ff58f9639a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:35.186316 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-6442a743-47b2-4f7b-9f48-02ff58f9639a None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:35.187826 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-6442a743-47b2-4f7b-9f48-02ff58f9639a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:35.337653 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 14/28] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:35.338408 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400f45-f57e-49fa-98a1-e4ee8dc3b0a1 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:35.344175 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 15/29] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:35.363624 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:35.521411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442a743-47b2-4f7b-9f48-02ff58f9639a None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:35.528001 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9400f45-f57e-49fa-98a1-e4ee8dc3b0a1 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:35.596461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b092beb-6bfd-424c-81cf-f85770fcf918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:35.597884 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b092beb-6bfd-424c-81cf-f85770fcf918 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:35.597884 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b092beb-6bfd-424c-81cf-f85770fcf918 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:35.597884 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b092beb-6bfd-424c-81cf-f85770fcf918 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:35.637045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b092beb-6bfd-424c-81cf-f85770fcf918 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:35.638917 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b092beb-6bfd-424c-81cf-f85770fcf918 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-2b092beb-6bfd-424c-81cf-f85770fcf918 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:30:35.665491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:35.666373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:30:35.667147 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:30:35.667147 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:30:35.667147 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:35.668890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 15/30] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:35.676112 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b092beb-6bfd-424c-81cf-f85770fcf918 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:35.777464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6442a743-47b2-4f7b-9f48-02ff58f9639a None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:35.816351 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:35.837423 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:35.842047 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7214e37-bb39-4e8e-a2cf-7c4bb870f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:35.848175 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7214e37-bb39-4e8e-a2cf-7c4bb870f45b None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:35.850241 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7214e37-bb39-4e8e-a2cf-7c4bb870f45b None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:35.851958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7214e37-bb39-4e8e-a2cf-7c4bb870f45b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:35.872624 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7214e37-bb39-4e8e-a2cf-7c4bb870f45b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-c7214e37-bb39-4e8e-a2cf-7c4bb870f45b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:35.877986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:35.878814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:30:35.880065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:30:35.884550 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 16/31] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:30:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:30:35.887176 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7214e37-bb39-4e8e-a2cf-7c4bb870f45b None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:35.896367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b092beb-6bfd-424c-81cf-f85770fcf918 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:35.939931 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190626d7-6ba9-48c8-8456-490d4d33b8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:35.940983 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190626d7-6ba9-48c8-8456-490d4d33b8a2 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:35.941416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190626d7-6ba9-48c8-8456-490d4d33b8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:35.941954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190626d7-6ba9-48c8-8456-490d4d33b8a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:35.942791 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190626d7-6ba9-48c8-8456-490d4d33b8a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:35.943213 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190626d7-6ba9-48c8-8456-490d4d33b8a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:35.945041 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190626d7-6ba9-48c8-8456-490d4d33b8a2 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:35.958258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:30:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:35.959336 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190626d7-6ba9-48c8-8456-490d4d33b8a2 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:36.000114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7214e37-bb39-4e8e-a2cf-7c4bb870f45b None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:36.035818 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5324fcd-e08d-478f-b842-abb3d388b0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:36.036813 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5324fcd-e08d-478f-b842-abb3d388b0ff None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.037514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5324fcd-e08d-478f-b842-abb3d388b0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.037986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5324fcd-e08d-478f-b842-abb3d388b0ff None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.039038 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5324fcd-e08d-478f-b842-abb3d388b0ff None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:36.040929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5324fcd-e08d-478f-b842-abb3d388b0ff None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:36.067366 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 17/33] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Oct 22 20:30:35 2022] POST /identity/v3/roles => generated 219 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:36.068739 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5324fcd-e08d-478f-b842-abb3d388b0ff None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:36.097890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190626d7-6ba9-48c8-8456-490d4d33b8a2 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:36.153528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:36.182838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:36.192530 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c847-a41d-46ec-ba73-6d321fa1a391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:36.193641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c847-a41d-46ec-ba73-6d321fa1a391 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.194114 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c847-a41d-46ec-ba73-6d321fa1a391 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.194659 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124c847-a41d-46ec-ba73-6d321fa1a391 None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.195597 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c847-a41d-46ec-ba73-6d321fa1a391 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:36.196109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c847-a41d-46ec-ba73-6d321fa1a391 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:36.197863 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124c847-a41d-46ec-ba73-6d321fa1a391 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:36.229850 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 17/34] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:36.232864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c847-a41d-46ec-ba73-6d321fa1a391 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:36.305923 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5324fcd-e08d-478f-b842-abb3d388b0ff None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:36.363816 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468ed4e-7080-4288-8f29-e33576277528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:36.364810 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468ed4e-7080-4288-8f29-e33576277528 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.365280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468ed4e-7080-4288-8f29-e33576277528 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.365734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4468ed4e-7080-4288-8f29-e33576277528 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.366706 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468ed4e-7080-4288-8f29-e33576277528 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:36.369186 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4468ed4e-7080-4288-8f29-e33576277528 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:36.389757 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 18/35] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Oct 22 20:30:36 2022] POST /identity/v3/roles => generated 225 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:36.390910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468ed4e-7080-4288-8f29-e33576277528 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:36.424662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124c847-a41d-46ec-ba73-6d321fa1a391 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:36.476006 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f5f2bb-be27-4141-825c-1e4575e273bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:36.477199 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f2bb-be27-4141-825c-1e4575e273bd None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.478307 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f2bb-be27-4141-825c-1e4575e273bd None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.478760 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f5f2bb-be27-4141-825c-1e4575e273bd None admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.481536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f2bb-be27-4141-825c-1e4575e273bd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:36.484674 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f5f2bb-be27-4141-825c-1e4575e273bd None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:36.528010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4468ed4e-7080-4288-8f29-e33576277528 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:36.543216 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:36.574086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842e45ad-e20e-47a6-acc6-98786e27a7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:36.574735 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e45ad-e20e-47a6-acc6-98786e27a7c5 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.575058 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e45ad-e20e-47a6-acc6-98786e27a7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.575366 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842e45ad-e20e-47a6-acc6-98786e27a7c5 None admin] PATH_INFO: `/v3/users/f2fce337ce4a417ea9044d0fbc87d49f` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.576602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e45ad-e20e-47a6-acc6-98786e27a7c5 None admin] RBAC: Authorizing `identity:get_user(user_id=f2fce337ce4a417ea9044d0fbc87d49f)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:36.578223 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842e45ad-e20e-47a6-acc6-98786e27a7c5 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:36.580029 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 19/36] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:36 2022] GET /identity/v3/users/f2fce337ce4a417ea9044d0fbc87d49f => generated 247 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:36.581268 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62ef9-9535-43bc-8f14-1fc73993cea3 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.581548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62ef9-9535-43bc-8f14-1fc73993cea3 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.581880 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b62ef9-9535-43bc-8f14-1fc73993cea3 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.583333 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 20/37] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:36.588638 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b62ef9-9535-43bc-8f14-1fc73993cea3 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:36.679163 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 18/38] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:30:36 2022] POST /identity/v3/projects => generated 301 bytes in 448 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:36.680589 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af7e2-9249-496e-b2b5-e99ac6d88c5e None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.680873 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af7e2-9249-496e-b2b5-e99ac6d88c5e None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.681142 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38af7e2-9249-496e-b2b5-e99ac6d88c5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.710515 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-c38af7e2-9249-496e-b2b5-e99ac6d88c5e None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:36.712277 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-c38af7e2-9249-496e-b2b5-e99ac6d88c5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:36.725834 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b62ef9-9535-43bc-8f14-1fc73993cea3 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:36.750297 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:36.768715 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c22fd-0f72-479d-89d0-d6582d037f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:36.769728 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c22fd-0f72-479d-89d0-d6582d037f72 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.770224 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c22fd-0f72-479d-89d0-d6582d037f72 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.770692 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187c22fd-0f72-479d-89d0-d6582d037f72 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.772355 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c22fd-0f72-479d-89d0-d6582d037f72 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:36.774367 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187c22fd-0f72-479d-89d0-d6582d037f72 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:36.776295 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 21/39] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:30:36.784544 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c22fd-0f72-479d-89d0-d6582d037f72 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:36.799335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 19/40] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:36.800952 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c07dca-4441-45f0-80bd-7513d1d59f55 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.801302 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c07dca-4441-45f0-80bd-7513d1d59f55 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.801651 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c07dca-4441-45f0-80bd-7513d1d59f55 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.803202 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 20/41] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:36.813035 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564c4d8-54fb-4312-a71f-d9bffccd1476 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.813318 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564c4d8-54fb-4312-a71f-d9bffccd1476 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.813727 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a564c4d8-54fb-4312-a71f-d9bffccd1476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.834595 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-a564c4d8-54fb-4312-a71f-d9bffccd1476 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:36.836016 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-a564c4d8-54fb-4312-a71f-d9bffccd1476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:36.859621 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:36.914353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 21/42] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:30:36.932634 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187c22fd-0f72-479d-89d0-d6582d037f72 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:36.968498 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf209be-380f-4691-9169-8ef6ac7b003a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:36.969107 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf209be-380f-4691-9169-8ef6ac7b003a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:36.969383 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf209be-380f-4691-9169-8ef6ac7b003a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:36.969647 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf209be-380f-4691-9169-8ef6ac7b003a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:36.970364 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf209be-380f-4691-9169-8ef6ac7b003a None admin] RBAC: Adding query filter params (role.id=7fb86065b4ef4b98873a590a9c66cfdc, scope.domain.id=default, user.id=f2fce337ce4a417ea9044d0fbc87d49f) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:36.970764 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf209be-380f-4691-9169-8ef6ac7b003a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:36.972318 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf209be-380f-4691-9169-8ef6ac7b003a None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:36.981068 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 22/43] 10.222.0.39 () {56 vars in 1322 bytes} [Sat Oct 22 20:30:36 2022] GET /identity/v3/role_assignments?user.id=f2fce337ce4a417ea9044d0fbc87d49f&scope.domain.id=default&role.id=7fb86065b4ef4b98873a590a9c66cfdc => generated 530 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:30:37.132128 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564c4d8-54fb-4312-a71f-d9bffccd1476 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:37.238254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:37.238887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf209be-380f-4691-9169-8ef6ac7b003a None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:37.249298 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a564c4d8-54fb-4312-a71f-d9bffccd1476 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:37.283104 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8a74b-a8cc-486f-bcde-2088c8340dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:37.283746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8a74b-a8cc-486f-bcde-2088c8340dce None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:37.284023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8a74b-a8cc-486f-bcde-2088c8340dce None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:37.284288 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f8a74b-a8cc-486f-bcde-2088c8340dce None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:37.284961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8a74b-a8cc-486f-bcde-2088c8340dce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:37.286467 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f8a74b-a8cc-486f-bcde-2088c8340dce None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:37.302369 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 22/44] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Oct 22 20:30:37 2022] POST /identity/v3/roles => generated 223 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:37.352207 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf209be-380f-4691-9169-8ef6ac7b003a None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:37.365183 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:37.393024 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e491b-bd15-4504-9bc2-7c1290ac2f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:37.393680 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e491b-bd15-4504-9bc2-7c1290ac2f83 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:37.393958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e491b-bd15-4504-9bc2-7c1290ac2f83 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:37.394230 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e491b-bd15-4504-9bc2-7c1290ac2f83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:37.395851 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e491b-bd15-4504-9bc2-7c1290ac2f83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:37.397028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995e491b-bd15-4504-9bc2-7c1290ac2f83 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:37.398692 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 23/45] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:30:37.405910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8a74b-a8cc-486f-bcde-2088c8340dce None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:37.516199 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f8a74b-a8cc-486f-bcde-2088c8340dce None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:37.552013 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8751fc5-003b-49ac-bc4a-0e2f44872073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:37.552633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751fc5-003b-49ac-bc4a-0e2f44872073 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:37.552916 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751fc5-003b-49ac-bc4a-0e2f44872073 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:37.553186 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8751fc5-003b-49ac-bc4a-0e2f44872073 None admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:37.553842 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751fc5-003b-49ac-bc4a-0e2f44872073 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:37.555370 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8751fc5-003b-49ac-bc4a-0e2f44872073 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:37.581676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:30:37 2022] POST /identity/v3/projects => generated 312 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:39.957553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413f03-6432-4327-933e-1d8b6e07ebd2 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:39.958072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413f03-6432-4327-933e-1d8b6e07ebd2 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:39.958145 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8413f03-6432-4327-933e-1d8b6e07ebd2 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:39.959540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 24/47] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:39.965430 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af480-808d-4dd2-ab6b-ac196872f539 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:39.965919 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af480-808d-4dd2-ab6b-ac196872f539 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:39.966004 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096af480-808d-4dd2-ab6b-ac196872f539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:39.987816 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-096af480-808d-4dd2-ab6b-ac196872f539 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:39.989036 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-096af480-808d-4dd2-ab6b-ac196872f539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:39.991103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:40.058369 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 24/48] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:40.373800 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413f03-6432-4327-933e-1d8b6e07ebd2 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:40.478384 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8413f03-6432-4327-933e-1d8b6e07ebd2 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:40.513579 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b210c2c0-023a-440a-a5f3-548f2513281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:40.514208 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c2c0-023a-440a-a5f3-548f2513281f None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:40.514462 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c2c0-023a-440a-a5f3-548f2513281f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:40.514726 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b210c2c0-023a-440a-a5f3-548f2513281f None admin] PATH_INFO: `/v3/domains/default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:40.515848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210c2c0-023a-440a-a5f3-548f2513281f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:40.517311 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b210c2c0-023a-440a-a5f3-548f2513281f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:40.518903 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 25/49] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:40.524981 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096af480-808d-4dd2-ab6b-ac196872f539 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:40.623519 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096af480-808d-4dd2-ab6b-ac196872f539 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:40.656911 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91c48d2-7e1f-4bf2-90ce-be112b0cd5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:40.657457 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c48d2-7e1f-4bf2-90ce-be112b0cd5a2 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:40.657734 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c48d2-7e1f-4bf2-90ce-be112b0cd5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:40.658023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91c48d2-7e1f-4bf2-90ce-be112b0cd5a2 None admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:40.658684 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c48d2-7e1f-4bf2-90ce-be112b0cd5a2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:40.660169 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91c48d2-7e1f-4bf2-90ce-be112b0cd5a2 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:40.669617 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:40.687367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 25/50] 10.222.0.39 () {60 vars in 1140 bytes} [Sat Oct 22 20:30:40 2022] POST /identity/v3/projects => generated 298 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:43.050316 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef844b9-91ef-4b3a-b5e0-fc640c147a43 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:43.050829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef844b9-91ef-4b3a-b5e0-fc640c147a43 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:43.050829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef844b9-91ef-4b3a-b5e0-fc640c147a43 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:43.052258 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 26/51] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:43.058027 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eaf6b-331a-477a-9654-3bbeda74a8af None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:43.058465 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eaf6b-331a-477a-9654-3bbeda74a8af None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:43.058548 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76eaf6b-331a-477a-9654-3bbeda74a8af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:43.077502 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-a76eaf6b-331a-477a-9654-3bbeda74a8af None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:43.078676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-a76eaf6b-331a-477a-9654-3bbeda74a8af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:43.145367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 26/52] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:43.458493 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef844b9-91ef-4b3a-b5e0-fc640c147a43 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:43.509950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:43.569435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef844b9-91ef-4b3a-b5e0-fc640c147a43 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:43.603370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57edc87-1a2a-4117-af3b-9603ac5bc1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:43.604001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57edc87-1a2a-4117-af3b-9603ac5bc1d4 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:43.604280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57edc87-1a2a-4117-af3b-9603ac5bc1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:43.604553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57edc87-1a2a-4117-af3b-9603ac5bc1d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:43.605979 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57edc87-1a2a-4117-af3b-9603ac5bc1d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:43.607495 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57edc87-1a2a-4117-af3b-9603ac5bc1d4 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:43.609059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:43.614700 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eaf6b-331a-477a-9654-3bbeda74a8af None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:43.711186 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76eaf6b-331a-477a-9654-3bbeda74a8af None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:43.731118 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:43.746224 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3dd1f7-b980-42d2-b654-50fe3463d047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:43.746847 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dd1f7-b980-42d2-b654-50fe3463d047 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:43.747126 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dd1f7-b980-42d2-b654-50fe3463d047 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:43.747432 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3dd1f7-b980-42d2-b654-50fe3463d047 None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:43.748083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dd1f7-b980-42d2-b654-50fe3463d047 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:43.749555 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3dd1f7-b980-42d2-b654-50fe3463d047 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:43.777988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 27/54] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:30:43 2022] POST /identity/v3/users => generated 275 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:47.322676 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b87ad4-0ae7-49fe-8528-9d778f78a23a None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:47.322676 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b87ad4-0ae7-49fe-8528-9d778f78a23a None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:47.322676 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b87ad4-0ae7-49fe-8528-9d778f78a23a None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:47.322676 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 28/55] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:47.328126 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598d16-01b8-499d-bb4b-446eb8e29d7e None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:47.328910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598d16-01b8-499d-bb4b-446eb8e29d7e None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:47.329386 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64598d16-01b8-499d-bb4b-446eb8e29d7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:47.356462 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-64598d16-01b8-499d-bb4b-446eb8e29d7e None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:47.357960 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-64598d16-01b8-499d-bb4b-446eb8e29d7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:47.444694 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 28/56] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:47.564273 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9342a0-d279-4335-b4f4-961c258c4ca0 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:47.564907 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9342a0-d279-4335-b4f4-961c258c4ca0 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:47.565371 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9342a0-d279-4335-b4f4-961c258c4ca0 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:47.566901 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 29/57] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:47.572366 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9521ebf-95a4-455d-8fbb-d72407aff38b None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:47.572919 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9521ebf-95a4-455d-8fbb-d72407aff38b None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:47.573396 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9521ebf-95a4-455d-8fbb-d72407aff38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:47.594682 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-d9521ebf-95a4-455d-8fbb-d72407aff38b None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:47.596241 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-d9521ebf-95a4-455d-8fbb-d72407aff38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:47.665391 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 29/58] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:47.872256 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9342a0-d279-4335-b4f4-961c258c4ca0 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:47.913341 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcb725-97eb-45bc-8ca2-84f4d44657ce None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:47.914003 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcb725-97eb-45bc-8ca2-84f4d44657ce None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:47.914488 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bcb725-97eb-45bc-8ca2-84f4d44657ce None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:47.916339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 30/59] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:47.921837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af457459-deb3-4835-9820-1704854bb4c1 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:47.922361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af457459-deb3-4835-9820-1704854bb4c1 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:47.922827 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af457459-deb3-4835-9820-1704854bb4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:47.960387 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-af457459-deb3-4835-9820-1704854bb4c1 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:47.961965 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-af457459-deb3-4835-9820-1704854bb4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:47.985600 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9342a0-d279-4335-b4f4-961c258c4ca0 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:47.992367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:48.002562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:48.037627 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c91e-bef2-4237-88ee-2ebedcf62131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:48.038829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c91e-bef2-4237-88ee-2ebedcf62131 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.040102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c91e-bef2-4237-88ee-2ebedcf62131 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.040702 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d83c91e-bef2-4237-88ee-2ebedcf62131 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.060138 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d83c91e-bef2-4237-88ee-2ebedcf62131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-7d83c91e-bef2-4237-88ee-2ebedcf62131 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:48.067081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:48.067926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:30:48.068650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:30:48.075118 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 31/60] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:30:48.075605 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 30/61] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:48.090499 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af457459-deb3-4835-9820-1704854bb4c1 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:48.131744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c91e-bef2-4237-88ee-2ebedcf62131 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:48.245719 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af457459-deb3-4835-9820-1704854bb4c1 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:48.308859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d83c91e-bef2-4237-88ee-2ebedcf62131 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:48.311108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ef0e7-f188-4123-a0ba-5980f7c179cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:48.311965 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef0e7-f188-4123-a0ba-5980f7c179cc None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.312435 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef0e7-f188-4123-a0ba-5980f7c179cc None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.312893 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50ef0e7-f188-4123-a0ba-5980f7c179cc None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.313763 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ef0e7-f188-4123-a0ba-5980f7c179cc None admin] RBAC: Adding query filter params (name=member) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:48.314250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ef0e7-f188-4123-a0ba-5980f7c179cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:48.315850 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50ef0e7-f188-4123-a0ba-5980f7c179cc None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:48.332896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 32/62] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:30:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:48.340351 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ef0e7-f188-4123-a0ba-5980f7c179cc None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:48.378311 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bddf9c-c393-4e87-a241-13999281ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:48.378995 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bddf9c-c393-4e87-a241-13999281ea4b None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.379224 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bddf9c-c393-4e87-a241-13999281ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.379520 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bddf9c-c393-4e87-a241-13999281ea4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.388327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:48.397998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bddf9c-c393-4e87-a241-13999281ea4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-81bddf9c-c393-4e87-a241-13999281ea4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:48.403373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:48.404167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:30:48.404972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:30:48.405535 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 31/63] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:30:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:30:48.406898 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdc4e1-5fbb-47de-8d36-81f7bfebcdbd None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.407174 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdc4e1-5fbb-47de-8d36-81f7bfebcdbd None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.409262 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdc4e1-5fbb-47de-8d36-81f7bfebcdbd None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.411352 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 32/64] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:48.415950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdc4e1-5fbb-47de-8d36-81f7bfebcdbd None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:48.466619 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:48.469896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50ef0e7-f188-4123-a0ba-5980f7c179cc None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:48.504637 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b62d43-5fca-47ef-881c-0640671f5b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:48.505273 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b62d43-5fca-47ef-881c-0640671f5b03 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.505555 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b62d43-5fca-47ef-881c-0640671f5b03 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.505830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b62d43-5fca-47ef-881c-0640671f5b03 None admin] PATH_INFO: `/v3/users/fa13cec188244763b5255c20594ee3b2` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.521131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b62d43-5fca-47ef-881c-0640671f5b03 None admin] RBAC: Authorizing `identity:get_user(user_id=fa13cec188244763b5255c20594ee3b2)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:48.522621 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b62d43-5fca-47ef-881c-0640671f5b03 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:48.524322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 33/65] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:48 2022] GET /identity/v3/users/fa13cec188244763b5255c20594ee3b2 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:48.525468 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42df8-e1b1-4777-be9a-d7bcb7a4c04d None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.525751 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42df8-e1b1-4777-be9a-d7bcb7a4c04d None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.526029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf42df8-e1b1-4777-be9a-d7bcb7a4c04d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.539623 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdc4e1-5fbb-47de-8d36-81f7bfebcdbd None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:48.544537 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-ecf42df8-e1b1-4777-be9a-d7bcb7a4c04d None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:48.545719 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-ecf42df8-e1b1-4777-be9a-d7bcb7a4c04d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:48.575857 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0b3ac-99cf-4a9b-9850-93feeaf02065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:48.576460 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b3ac-99cf-4a9b-9850-93feeaf02065 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.576733 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b3ac-99cf-4a9b-9850-93feeaf02065 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.576998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e0b3ac-99cf-4a9b-9850-93feeaf02065 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.577654 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0b3ac-99cf-4a9b-9850-93feeaf02065 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:48.577950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0b3ac-99cf-4a9b-9850-93feeaf02065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:48.579371 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e0b3ac-99cf-4a9b-9850-93feeaf02065 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:48.587529 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 33/66] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:48.588507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0b3ac-99cf-4a9b-9850-93feeaf02065 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:48.616198 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 34/67] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:48.616892 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf42df8-e1b1-4777-be9a-d7bcb7a4c04d None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:48.638816 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:48.705598 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:48.711790 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e0b3ac-99cf-4a9b-9850-93feeaf02065 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:48.723768 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf42df8-e1b1-4777-be9a-d7bcb7a4c04d None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:48.747636 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c21b4-5dba-4df1-a3cb-15b2d436d0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:48.748262 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c21b4-5dba-4df1-a3cb-15b2d436d0f3 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.748699 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c21b4-5dba-4df1-a3cb-15b2d436d0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.748970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681c21b4-5dba-4df1-a3cb-15b2d436d0f3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.758043 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e47bb18d-84a0-4065-ad64-2e2973d95930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:48.758671 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb18d-84a0-4065-ad64-2e2973d95930 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.758948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb18d-84a0-4065-ad64-2e2973d95930 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.759219 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e47bb18d-84a0-4065-ad64-2e2973d95930 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.759954 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681c21b4-5dba-4df1-a3cb-15b2d436d0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:48.760372 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bb18d-84a0-4065-ad64-2e2973d95930 None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:48.761827 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e47bb18d-84a0-4065-ad64-2e2973d95930 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:48.763659 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 35/68] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:30:48 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:48.764717 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ea00-0e0e-407c-a2a0-c84e425db8a8 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.765000 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ea00-0e0e-407c-a2a0-c84e425db8a8 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.765267 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ea00-0e0e-407c-a2a0-c84e425db8a8 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.766599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 36/69] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-681c21b4-5dba-4df1-a3cb-15b2d436d0f3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:48.770072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:48.770858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:30:48.772184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 34/70] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:30:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:48.772893 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ea00-0e0e-407c-a2a0-c84e425db8a8 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:48.776535 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c21b4-5dba-4df1-a3cb-15b2d436d0f3 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:48.859118 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:48.875881 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681c21b4-5dba-4df1-a3cb-15b2d436d0f3 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:48.877590 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ea00-0e0e-407c-a2a0-c84e425db8a8 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:48.909790 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e78bcf-92e4-46de-b9cc-695447628808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:48.910374 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e78bcf-92e4-46de-b9cc-695447628808 None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.910653 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e78bcf-92e4-46de-b9cc-695447628808 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.910927 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e78bcf-92e4-46de-b9cc-695447628808 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/users/fa13cec188244763b5255c20594ee3b2/roles/72c390b29d3240dd8c46b0fd1b18441e` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.912891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e78bcf-92e4-46de-b9cc-695447628808 None admin] RBAC: Authorizing `identity:create_grant(project_id=d64a8a99b0dd46f0beb4750f34503fcd, user_id=fa13cec188244763b5255c20594ee3b2, role_id=72c390b29d3240dd8c46b0fd1b18441e)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:48.914373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e78bcf-92e4-46de-b9cc-695447628808 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:48.915195 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56272977-f386-40eb-bef7-fb164b9fdecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:48.915859 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56272977-f386-40eb-bef7-fb164b9fdecd None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.916141 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56272977-f386-40eb-bef7-fb164b9fdecd None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.916477 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56272977-f386-40eb-bef7-fb164b9fdecd None admin] PATH_INFO: `/v3/users/f2fce337ce4a417ea9044d0fbc87d49f` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.917771 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56272977-f386-40eb-bef7-fb164b9fdecd None admin] RBAC: Authorizing `identity:get_user(user_id=f2fce337ce4a417ea9044d0fbc87d49f)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:48.918990 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56272977-f386-40eb-bef7-fb164b9fdecd None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:48.920568 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 37/71] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:48 2022] GET /identity/v3/users/f2fce337ce4a417ea9044d0fbc87d49f => generated 247 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:48.920568 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873279-cc74-41fc-b761-5c986ae80947 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:48.920568 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873279-cc74-41fc-b761-5c986ae80947 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:48.920568 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62873279-cc74-41fc-b761-5c986ae80947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:48.933815 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 35/72] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:30:48 2022] PUT /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/users/fa13cec188244763b5255c20594ee3b2/roles/72c390b29d3240dd8c46b0fd1b18441e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:30:48.934635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e78bcf-92e4-46de-b9cc-695447628808 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:48.941023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-62873279-cc74-41fc-b761-5c986ae80947 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:48.942245 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-62873279-cc74-41fc-b761-5c986ae80947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:48.955547 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:49.019765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 38/73] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:49.020686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873279-cc74-41fc-b761-5c986ae80947 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.070846 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e78bcf-92e4-46de-b9cc-695447628808 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.124397 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e88e8-141e-4303-b464-c8c5d340ec64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.125633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e88e8-141e-4303-b464-c8c5d340ec64 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.126752 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:49.127734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e88e8-141e-4303-b464-c8c5d340ec64 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.128537 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978e88e8-141e-4303-b464-c8c5d340ec64 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.129480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e88e8-141e-4303-b464-c8c5d340ec64 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:49.130096 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e88e8-141e-4303-b464-c8c5d340ec64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:49.132446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978e88e8-141e-4303-b464-c8c5d340ec64 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:49.146068 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 36/74] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:30:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:49.147552 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e88e8-141e-4303-b464-c8c5d340ec64 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.149435 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62873279-cc74-41fc-b761-5c986ae80947 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.191906 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbd00d-69e2-4fa4-b8a8-0af55751fbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.192650 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbd00d-69e2-4fa4-b8a8-0af55751fbc0 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.192987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbd00d-69e2-4fa4-b8a8-0af55751fbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.193317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbd00d-69e2-4fa4-b8a8-0af55751fbc0 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.194575 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbd00d-69e2-4fa4-b8a8-0af55751fbc0 None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:49.196451 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbd00d-69e2-4fa4-b8a8-0af55751fbc0 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:49.198969 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 39/75] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:30:49 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:49.199870 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbd00d-69e2-4fa4-b8a8-0af55751fbc0 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.243033 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:49.268546 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978e88e8-141e-4303-b464-c8c5d340ec64 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.303697 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b21c-57a7-401d-85a3-ad6c49aed79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.304566 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b21c-57a7-401d-85a3-ad6c49aed79f None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.304986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b21c-57a7-401d-85a3-ad6c49aed79f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.305427 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0b21c-57a7-401d-85a3-ad6c49aed79f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.316787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0b21c-57a7-401d-85a3-ad6c49aed79f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-99a0b21c-57a7-401d-85a3-ad6c49aed79f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:49.322297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:49.323331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:30:49.324289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:30:49.325562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbd00d-69e2-4fa4-b8a8-0af55751fbc0 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.326372 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 37/76] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:49.327448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b21c-57a7-401d-85a3-ad6c49aed79f None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.370933 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0dca2-c627-45e0-8157-eb9dcc158b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.372251 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0dca2-c627-45e0-8157-eb9dcc158b36 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.372687 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0dca2-c627-45e0-8157-eb9dcc158b36 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.373231 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c0dca2-c627-45e0-8157-eb9dcc158b36 None admin] PATH_INFO: `/v3/users/fa13cec188244763b5255c20594ee3b2` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.374408 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0dca2-c627-45e0-8157-eb9dcc158b36 None admin] RBAC: Authorizing `identity:get_user(user_id=fa13cec188244763b5255c20594ee3b2)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:49.376051 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c0dca2-c627-45e0-8157-eb9dcc158b36 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:49.380566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 40/77] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:49 2022] GET /identity/v3/users/fa13cec188244763b5255c20594ee3b2 => generated 275 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:49.380566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0dca2-c627-45e0-8157-eb9dcc158b36 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.409388 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:49.440286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0b21c-57a7-401d-85a3-ad6c49aed79f None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.477276 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b944c8-e0d8-4f09-a687-68eb2bcbe9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.477824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b944c8-e0d8-4f09-a687-68eb2bcbe9a6 None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.478128 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b944c8-e0d8-4f09-a687-68eb2bcbe9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.478385 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b944c8-e0d8-4f09-a687-68eb2bcbe9a6 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/users/f2fce337ce4a417ea9044d0fbc87d49f/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.480866 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b944c8-e0d8-4f09-a687-68eb2bcbe9a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=d64a8a99b0dd46f0beb4750f34503fcd, user_id=f2fce337ce4a417ea9044d0fbc87d49f, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:49.482324 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b944c8-e0d8-4f09-a687-68eb2bcbe9a6 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:49.489169 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c0dca2-c627-45e0-8157-eb9dcc158b36 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.493022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:49.499354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 38/78] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:30:49 2022] PUT /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/users/f2fce337ce4a417ea9044d0fbc87d49f/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:30:49.499621 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b944c8-e0d8-4f09-a687-68eb2bcbe9a6 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.548469 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36d362-2ca5-4619-b1d0-8d6d5a08102a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.549749 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36d362-2ca5-4619-b1d0-8d6d5a08102a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.551221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36d362-2ca5-4619-b1d0-8d6d5a08102a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.551741 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a36d362-2ca5-4619-b1d0-8d6d5a08102a None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.552626 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36d362-2ca5-4619-b1d0-8d6d5a08102a None admin] RBAC: Adding query filter params (name=member) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:49.553149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36d362-2ca5-4619-b1d0-8d6d5a08102a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:49.554861 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a36d362-2ca5-4619-b1d0-8d6d5a08102a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:49.569669 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 41/79] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:30:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:49.575538 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36d362-2ca5-4619-b1d0-8d6d5a08102a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.627315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b944c8-e0d8-4f09-a687-68eb2bcbe9a6 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.664298 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409577-6d31-4c97-8516-6e066d4e5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.665338 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409577-6d31-4c97-8516-6e066d4e5d18 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.665818 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409577-6d31-4c97-8516-6e066d4e5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.666281 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04409577-6d31-4c97-8516-6e066d4e5d18 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.667771 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04409577-6d31-4c97-8516-6e066d4e5d18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:49.669485 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04409577-6d31-4c97-8516-6e066d4e5d18 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:49.671344 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 39/80] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:49.672308 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:49.673021 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409577-6d31-4c97-8516-6e066d4e5d18 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.695424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a36d362-2ca5-4619-b1d0-8d6d5a08102a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.735292 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff889f-c539-4ac0-b85e-cda2a63499f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.735887 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff889f-c539-4ac0-b85e-cda2a63499f4 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.736161 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff889f-c539-4ac0-b85e-cda2a63499f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.736426 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ff889f-c539-4ac0-b85e-cda2a63499f4 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.737533 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff889f-c539-4ac0-b85e-cda2a63499f4 None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:49.738972 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ff889f-c539-4ac0-b85e-cda2a63499f4 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:49.740626 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 42/81] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:30:49 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:49.741484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff889f-c539-4ac0-b85e-cda2a63499f4 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.748191 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:49.785253 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04409577-6d31-4c97-8516-6e066d4e5d18 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.840006 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0017a3-8728-4ba1-89d0-be83179fb096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.840820 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0017a3-8728-4ba1-89d0-be83179fb096 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.841145 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0017a3-8728-4ba1-89d0-be83179fb096 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.841843 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0017a3-8728-4ba1-89d0-be83179fb096 None admin] PATH_INFO: `/v3/users/fa13cec188244763b5255c20594ee3b2` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.843381 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0017a3-8728-4ba1-89d0-be83179fb096 None admin] RBAC: Authorizing `identity:get_user(user_id=fa13cec188244763b5255c20594ee3b2)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:49.845369 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0017a3-8728-4ba1-89d0-be83179fb096 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:49.848022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 40/82] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:49 2022] GET /identity/v3/users/fa13cec188244763b5255c20594ee3b2 => generated 275 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:49.848925 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0017a3-8728-4ba1-89d0-be83179fb096 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.859135 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ff889f-c539-4ac0-b85e-cda2a63499f4 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:49.902117 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f5070-cdd2-43b4-a42d-5cbfb7c1fb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:49.902999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f5070-cdd2-43b4-a42d-5cbfb7c1fb50 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:49.903295 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f5070-cdd2-43b4-a42d-5cbfb7c1fb50 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:49.903573 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f5070-cdd2-43b4-a42d-5cbfb7c1fb50 None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:49.904480 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f5070-cdd2-43b4-a42d-5cbfb7c1fb50 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:49.906666 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f5070-cdd2-43b4-a42d-5cbfb7c1fb50 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:49.939435 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 43/83] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:30:49 2022] POST /identity/v3/users => generated 289 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:49.940551 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f5070-cdd2-43b4-a42d-5cbfb7c1fb50 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:49.948512 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:49.985169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0017a3-8728-4ba1-89d0-be83179fb096 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:50.057233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e848aca-dfe9-4910-b204-da090b74b4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:50.057824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e848aca-dfe9-4910-b204-da090b74b4d9 None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:50.058096 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e848aca-dfe9-4910-b204-da090b74b4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:50.058363 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e848aca-dfe9-4910-b204-da090b74b4d9 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/users/fa13cec188244763b5255c20594ee3b2/roles/717e33c007ba49a5af257abafa205f0f` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:50.062562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e848aca-dfe9-4910-b204-da090b74b4d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d64a8a99b0dd46f0beb4750f34503fcd, user_id=fa13cec188244763b5255c20594ee3b2, role_id=717e33c007ba49a5af257abafa205f0f)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:50.065465 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e848aca-dfe9-4910-b204-da090b74b4d9 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:50.070776 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:50.091916 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 41/84] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:30:49 2022] PUT /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/users/fa13cec188244763b5255c20594ee3b2/roles/717e33c007ba49a5af257abafa205f0f => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:30:50.144278 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f5070-cdd2-43b4-a42d-5cbfb7c1fb50 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:50.184565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d13541-10c0-4c28-ba9e-ef3239d10b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:50.185635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d13541-10c0-4c28-ba9e-ef3239d10b9e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:50.186111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d13541-10c0-4c28-ba9e-ef3239d10b9e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:50.186585 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d13541-10c0-4c28-ba9e-ef3239d10b9e None admin] PATH_INFO: `/v3/projects/e31f3a2e4bcc4c1a9f0d016e4626c7d9` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:50.188311 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d13541-10c0-4c28-ba9e-ef3239d10b9e None admin] RBAC: Authorizing `identity:get_project(project_id=e31f3a2e4bcc4c1a9f0d016e4626c7d9)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:50.190099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d13541-10c0-4c28-ba9e-ef3239d10b9e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:50.192213 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 44/85] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:30:49 2022] GET /identity/v3/projects/e31f3a2e4bcc4c1a9f0d016e4626c7d9 => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:50.199305 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e848aca-dfe9-4910-b204-da090b74b4d9 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:50.343677 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e848aca-dfe9-4910-b204-da090b74b4d9 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:50.381156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41385eb5-fcba-4b12-a9ae-b51b7fd5704f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:50.381861 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385eb5-fcba-4b12-a9ae-b51b7fd5704f None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:50.382123 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385eb5-fcba-4b12-a9ae-b51b7fd5704f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:50.382391 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41385eb5-fcba-4b12-a9ae-b51b7fd5704f None admin] PATH_INFO: `/v3/projects/e31f3a2e4bcc4c1a9f0d016e4626c7d9/users/fa13cec188244763b5255c20594ee3b2/roles/72c390b29d3240dd8c46b0fd1b18441e` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:50.384349 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41385eb5-fcba-4b12-a9ae-b51b7fd5704f None admin] RBAC: Authorizing `identity:create_grant(project_id=e31f3a2e4bcc4c1a9f0d016e4626c7d9, user_id=fa13cec188244763b5255c20594ee3b2, role_id=72c390b29d3240dd8c46b0fd1b18441e)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:50.385804 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41385eb5-fcba-4b12-a9ae-b51b7fd5704f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:50.410937 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 42/86] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:30:50 2022] PUT /identity/v3/projects/e31f3a2e4bcc4c1a9f0d016e4626c7d9/users/fa13cec188244763b5255c20594ee3b2/roles/72c390b29d3240dd8c46b0fd1b18441e => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:30:51.724459 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306770-45b1-4c5d-8e00-35019be250aa None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:51.724972 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306770-45b1-4c5d-8e00-35019be250aa None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:51.725043 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c306770-45b1-4c5d-8e00-35019be250aa None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:51.726380 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 45/87] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:51.732181 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d372f2-7da9-446e-a1f9-622c6004ac23 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:51.732584 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d372f2-7da9-446e-a1f9-622c6004ac23 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:51.732767 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d372f2-7da9-446e-a1f9-622c6004ac23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:51.755888 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-66d372f2-7da9-446e-a1f9-622c6004ac23 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:51.757171 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-66d372f2-7da9-446e-a1f9-622c6004ac23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:51.820766 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:51.849409 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 43/88] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:52.338937 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c306770-45b1-4c5d-8e00-35019be250aa None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:52.423619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:52.463824 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c306770-45b1-4c5d-8e00-35019be250aa None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:52.503907 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b89f8-fe48-4c6d-aea0-d619debe5123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:52.504543 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b89f8-fe48-4c6d-aea0-d619debe5123 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:52.504817 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b89f8-fe48-4c6d-aea0-d619debe5123 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:52.505084 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7b89f8-fe48-4c6d-aea0-d619debe5123 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:52.520134 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7b89f8-fe48-4c6d-aea0-d619debe5123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-7e7b89f8-fe48-4c6d-aea0-d619debe5123 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:52.526580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:52.527461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:52.528620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 46/89] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:52.535370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d372f2-7da9-446e-a1f9-622c6004ac23 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:52.672125 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d372f2-7da9-446e-a1f9-622c6004ac23 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:52.714732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dd7d24-e295-4e82-a1f9-77d192c794f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:52.715729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7d24-e295-4e82-a1f9-77d192c794f4 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:52.716221 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7d24-e295-4e82-a1f9-77d192c794f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:52.716675 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dd7d24-e295-4e82-a1f9-77d192c794f4 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:52.717553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd7d24-e295-4e82-a1f9-77d192c794f4 None admin] RBAC: Adding query filter params (name=member) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:52.718039 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd7d24-e295-4e82-a1f9-77d192c794f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:52.719660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dd7d24-e295-4e82-a1f9-77d192c794f4 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:52.729018 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 44/90] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:30:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:52.735641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b89f8-fe48-4c6d-aea0-d619debe5123 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:52.795226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e635-324d-430e-992e-2b7d8f2a9ec0 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:52.796195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e635-324d-430e-992e-2b7d8f2a9ec0 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:52.796656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3e635-324d-430e-992e-2b7d8f2a9ec0 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:52.798218 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 45/91] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:52.804087 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db15b60-a168-4068-bf87-903fb3f800d9 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:52.804738 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db15b60-a168-4068-bf87-903fb3f800d9 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:52.805199 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db15b60-a168-4068-bf87-903fb3f800d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:52.827318 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-7db15b60-a168-4068-bf87-903fb3f800d9 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:52.836673 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-7db15b60-a168-4068-bf87-903fb3f800d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:52.896499 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7b89f8-fe48-4c6d-aea0-d619debe5123 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:52.897824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:52.941602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 46/92] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:30:52.953697 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:52.963622 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7cda08-205c-4055-997e-8a52262cf5a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:52.964257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cda08-205c-4055-997e-8a52262cf5a3 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:52.964531 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cda08-205c-4055-997e-8a52262cf5a3 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:52.964795 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7cda08-205c-4055-997e-8a52262cf5a3 None admin] PATH_INFO: `/v3/users/fa13cec188244763b5255c20594ee3b2` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:52.965921 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cda08-205c-4055-997e-8a52262cf5a3 None admin] RBAC: Authorizing `identity:get_user(user_id=fa13cec188244763b5255c20594ee3b2)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:52.967457 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7cda08-205c-4055-997e-8a52262cf5a3 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:52.969399 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 47/93] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:52 2022] GET /identity/v3/users/fa13cec188244763b5255c20594ee3b2 => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:52.975175 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db15b60-a168-4068-bf87-903fb3f800d9 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:53.090530 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db15b60-a168-4068-bf87-903fb3f800d9 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:53.130637 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0370ada-10cb-4ea9-a843-832f0f64ec1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:53.131279 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0370ada-10cb-4ea9-a843-832f0f64ec1f None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:53.131615 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0370ada-10cb-4ea9-a843-832f0f64ec1f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:53.131889 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0370ada-10cb-4ea9-a843-832f0f64ec1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:53.189799 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:53.216364 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0370ada-10cb-4ea9-a843-832f0f64ec1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:53.217758 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0370ada-10cb-4ea9-a843-832f0f64ec1f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:53.246205 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b99a9-8a1f-4262-b439-3503f8429fba None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:53.246381 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b99a9-8a1f-4262-b439-3503f8429fba None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:53.246779 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7b99a9-8a1f-4262-b439-3503f8429fba None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:53.248147 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 48/94] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:53.264746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7bfd-5bbf-4b98-b4cd-51eb91bd3aaf None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:53.265023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7bfd-5bbf-4b98-b4cd-51eb91bd3aaf None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:53.265393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ee7bfd-5bbf-4b98-b4cd-51eb91bd3aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:53.294837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-66ee7bfd-5bbf-4b98-b4cd-51eb91bd3aaf None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:53.296158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-66ee7bfd-5bbf-4b98-b4cd-51eb91bd3aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:53.330086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 47/95] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:30:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:30:53.337086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0370ada-10cb-4ea9-a843-832f0f64ec1f None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:53.430116 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 49/96] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:53.459736 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:53.491064 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7bfd-5bbf-4b98-b4cd-51eb91bd3aaf None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:53.494162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0370ada-10cb-4ea9-a843-832f0f64ec1f None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:53.551770 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09400c2a-0d70-4ebb-b55e-3b7586bff5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:53.552453 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09400c2a-0d70-4ebb-b55e-3b7586bff5d3 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:53.552736 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09400c2a-0d70-4ebb-b55e-3b7586bff5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:53.553008 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09400c2a-0d70-4ebb-b55e-3b7586bff5d3 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:53.554923 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09400c2a-0d70-4ebb-b55e-3b7586bff5d3 None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:53.556730 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09400c2a-0d70-4ebb-b55e-3b7586bff5d3 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:53.558387 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 48/97] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:30:53 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:53.565127 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09400c2a-0d70-4ebb-b55e-3b7586bff5d3 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:53.728619 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09400c2a-0d70-4ebb-b55e-3b7586bff5d3 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:53.731111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ee7bfd-5bbf-4b98-b4cd-51eb91bd3aaf None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:53.783104 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:53.793432 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83758871-95b2-4f9c-a959-5bc16216321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:53.794853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758871-95b2-4f9c-a959-5bc16216321a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:53.795657 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd3e57-118e-4d79-874a-e4d3a33dbc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:53.796169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758871-95b2-4f9c-a959-5bc16216321a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:53.797312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd3e57-118e-4d79-874a-e4d3a33dbc31 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:53.797779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83758871-95b2-4f9c-a959-5bc16216321a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:53.798722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83758871-95b2-4f9c-a959-5bc16216321a None admin] RBAC: Adding query filter params (role.id=72c390b29d3240dd8c46b0fd1b18441e, scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd, user.id=fa13cec188244763b5255c20594ee3b2) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:53.799190 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd3e57-118e-4d79-874a-e4d3a33dbc31 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:53.799682 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bd3e57-118e-4d79-874a-e4d3a33dbc31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:53.800651 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83758871-95b2-4f9c-a959-5bc16216321a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:53.802304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83758871-95b2-4f9c-a959-5bc16216321a None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:53.812387 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 49/98] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:30:53 2022] GET /identity/v3/role_assignments?user.id=fa13cec188244763b5255c20594ee3b2&scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd&role.id=72c390b29d3240dd8c46b0fd1b18441e => generated 608 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:53.814667 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485cdcd-e114-4e7b-9649-697495b28a68 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:53.816475 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485cdcd-e114-4e7b-9649-697495b28a68 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:53.817731 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d485cdcd-e114-4e7b-9649-697495b28a68 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:53.821641 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 50/99] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:53.827036 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bd3e57-118e-4d79-874a-e4d3a33dbc31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:53.830580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45e6a-84fb-4d7c-8e56-2ef75a794b5e None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:53.831158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45e6a-84fb-4d7c-8e56-2ef75a794b5e None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-f4bd3e57-118e-4d79-874a-e4d3a33dbc31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:53.836367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:53.837188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:30:53.837914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:53.839292 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa45e6a-84fb-4d7c-8e56-2ef75a794b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:53.840788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 50/100] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:30:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:30:53.853726 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd3e57-118e-4d79-874a-e4d3a33dbc31 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:53.878894 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-2aa45e6a-84fb-4d7c-8e56-2ef75a794b5e None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:53.882103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-2aa45e6a-84fb-4d7c-8e56-2ef75a794b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:53.887676 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:54.047231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 51/101] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:30:54.048444 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa45e6a-84fb-4d7c-8e56-2ef75a794b5e None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:54.050607 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bd3e57-118e-4d79-874a-e4d3a33dbc31 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:54.089062 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872dde3-b9d3-4092-8e1e-d62921c7381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:54.089687 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872dde3-b9d3-4092-8e1e-d62921c7381d None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.089970 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872dde3-b9d3-4092-8e1e-d62921c7381d None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.090243 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b872dde3-b9d3-4092-8e1e-d62921c7381d None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.090917 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872dde3-b9d3-4092-8e1e-d62921c7381d None admin] RBAC: Adding query filter params (name=admin) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:54.091220 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872dde3-b9d3-4092-8e1e-d62921c7381d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:54.092643 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b872dde3-b9d3-4092-8e1e-d62921c7381d None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:54.102303 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 51/102] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:54.110571 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872dde3-b9d3-4092-8e1e-d62921c7381d None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:54.217175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:54.274741 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa45e6a-84fb-4d7c-8e56-2ef75a794b5e None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:54.311078 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b872dde3-b9d3-4092-8e1e-d62921c7381d None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:54.364268 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08869479-3f09-4c2f-b880-4dbae7b26787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:54.367613 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869479-3f09-4c2f-b880-4dbae7b26787 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.368197 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869479-3f09-4c2f-b880-4dbae7b26787 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.368663 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08869479-3f09-4c2f-b880-4dbae7b26787 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.370500 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b020fcd-572a-424f-b497-4c1c06943c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:54.371154 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b020fcd-572a-424f-b497-4c1c06943c29 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.371470 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b020fcd-572a-424f-b497-4c1c06943c29 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.375104 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b020fcd-572a-424f-b497-4c1c06943c29 None admin] PATH_INFO: `/v3/users/f2fce337ce4a417ea9044d0fbc87d49f` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.376405 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b020fcd-572a-424f-b497-4c1c06943c29 None admin] RBAC: Authorizing `identity:get_user(user_id=f2fce337ce4a417ea9044d0fbc87d49f)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:54.377889 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b020fcd-572a-424f-b497-4c1c06943c29 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:54.379879 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 52/103] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:54 2022] GET /identity/v3/users/f2fce337ce4a417ea9044d0fbc87d49f => generated 247 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:54.380289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:54.381375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd762b-1200-4d9f-8dd6-4bd25066a308 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.381375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd762b-1200-4d9f-8dd6-4bd25066a308 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.381657 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dd762b-1200-4d9f-8dd6-4bd25066a308 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.382858 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 53/104] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:54 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:54.386588 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08869479-3f09-4c2f-b880-4dbae7b26787 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:54.389276 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd762b-1200-4d9f-8dd6-4bd25066a308 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-08869479-3f09-4c2f-b880-4dbae7b26787 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:54.394198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:54.395056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:30:54.395821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 52/105] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:30:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:54.396923 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e34c4a-d4b2-4902-8b84-e84de1ffb0b7 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.396923 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e34c4a-d4b2-4902-8b84-e84de1ffb0b7 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.397883 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e34c4a-d4b2-4902-8b84-e84de1ffb0b7 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.404092 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 53/106] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:54 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:54.405186 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b646e7-2675-4b05-8ec8-f5e528078be9 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.405473 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b646e7-2675-4b05-8ec8-f5e528078be9 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.405747 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b646e7-2675-4b05-8ec8-f5e528078be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.427448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-f6b646e7-2675-4b05-8ec8-f5e528078be9 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:54.428651 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-f6b646e7-2675-4b05-8ec8-f5e528078be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:54.499146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 54/107] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:54.500222 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b646e7-2675-4b05-8ec8-f5e528078be9 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:54.501641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dd762b-1200-4d9f-8dd6-4bd25066a308 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:54.523700 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:54.538045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee296c7e-e6b2-4761-9b41-ff7e50cd9a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:54.538649 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee296c7e-e6b2-4761-9b41-ff7e50cd9a87 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.538926 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee296c7e-e6b2-4761-9b41-ff7e50cd9a87 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.539196 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee296c7e-e6b2-4761-9b41-ff7e50cd9a87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.608072 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee296c7e-e6b2-4761-9b41-ff7e50cd9a87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:54.609540 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee296c7e-e6b2-4761-9b41-ff7e50cd9a87 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:54.615117 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b646e7-2675-4b05-8ec8-f5e528078be9 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:54.643307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:54.651803 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fa0df-b4f4-4a9c-a07a-d595c8060990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:54.652251 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa0df-b4f4-4a9c-a07a-d595c8060990 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.652527 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa0df-b4f4-4a9c-a07a-d595c8060990 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.652794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fa0df-b4f4-4a9c-a07a-d595c8060990 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.653458 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fa0df-b4f4-4a9c-a07a-d595c8060990 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:54.653746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fa0df-b4f4-4a9c-a07a-d595c8060990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:54.655271 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fa0df-b4f4-4a9c-a07a-d595c8060990 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:54.663742 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 55/108] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:30:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:54.665004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ae5b9-ee28-43b4-8b86-52678fcefddb None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.665295 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ae5b9-ee28-43b4-8b86-52678fcefddb None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.665551 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ae5b9-ee28-43b4-8b86-52678fcefddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.684150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-333ae5b9-ee28-43b4-8b86-52678fcefddb None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:54.685601 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-333ae5b9-ee28-43b4-8b86-52678fcefddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:54.717643 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 54/109] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:30:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:30:54.718810 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee296c7e-e6b2-4761-9b41-ff7e50cd9a87 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:54.742129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:54.760383 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 56/110] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:54.761540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ae5b9-ee28-43b4-8b86-52678fcefddb None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:54.836737 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee296c7e-e6b2-4761-9b41-ff7e50cd9a87 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:54.871299 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cab15-11e3-4e9a-8d3d-d49441f4d561 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:54.871956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cab15-11e3-4e9a-8d3d-d49441f4d561 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.872127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cab15-11e3-4e9a-8d3d-d49441f4d561 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.872395 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29cab15-11e3-4e9a-8d3d-d49441f4d561 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.879149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ae5b9-ee28-43b4-8b86-52678fcefddb None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:54.882575 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29cab15-11e3-4e9a-8d3d-d49441f4d561 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-c29cab15-11e3-4e9a-8d3d-d49441f4d561 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:54.887496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:54.888327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:54.889074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 55/111] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:54.889676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cab15-11e3-4e9a-8d3d-d49441f4d561 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:54.906022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:54.922258 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac1d33-9605-4428-929c-b66670105a9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:54.922893 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac1d33-9605-4428-929c-b66670105a9e None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:54.923364 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac1d33-9605-4428-929c-b66670105a9e None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:54.923467 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac1d33-9605-4428-929c-b66670105a9e None admin] PATH_INFO: `/v3/users/fa13cec188244763b5255c20594ee3b2` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:54.924597 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac1d33-9605-4428-929c-b66670105a9e None admin] RBAC: Authorizing `identity:get_user(user_id=fa13cec188244763b5255c20594ee3b2)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:54.926053 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac1d33-9605-4428-929c-b66670105a9e None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:54.927812 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 57/112] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:54 2022] GET /identity/v3/users/fa13cec188244763b5255c20594ee3b2 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:54.932963 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac1d33-9605-4428-929c-b66670105a9e None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:54.975559 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:54.996351 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29cab15-11e3-4e9a-8d3d-d49441f4d561 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.030084 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a658409-3252-4135-aec7-7b65b4bbfc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.030724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a658409-3252-4135-aec7-7b65b4bbfc81 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.031007 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a658409-3252-4135-aec7-7b65b4bbfc81 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.031312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a658409-3252-4135-aec7-7b65b4bbfc81 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.032473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a658409-3252-4135-aec7-7b65b4bbfc81 None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.033941 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a658409-3252-4135-aec7-7b65b4bbfc81 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.035615 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 56/113] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:30:54 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:55.040056 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a658409-3252-4135-aec7-7b65b4bbfc81 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.043124 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac1d33-9605-4428-929c-b66670105a9e None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.080155 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda3618-9403-48bb-a2c8-e06b9e335599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.080783 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda3618-9403-48bb-a2c8-e06b9e335599 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.081063 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda3618-9403-48bb-a2c8-e06b9e335599 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.081336 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eda3618-9403-48bb-a2c8-e06b9e335599 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.091421 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eda3618-9403-48bb-a2c8-e06b9e335599 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-2eda3618-9403-48bb-a2c8-e06b9e335599 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:55.096580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:55.097424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:30:55.098157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 58/114] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:55.103252 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda3618-9403-48bb-a2c8-e06b9e335599 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.141393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a658409-3252-4135-aec7-7b65b4bbfc81 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.150892 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:55.177485 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef116fb-401b-4395-b68d-fad34b249856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.178095 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef116fb-401b-4395-b68d-fad34b249856 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.178405 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef116fb-401b-4395-b68d-fad34b249856 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.178679 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef116fb-401b-4395-b68d-fad34b249856 None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.179381 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef116fb-401b-4395-b68d-fad34b249856 None admin] RBAC: Adding query filter params (name=member) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:55.179686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef116fb-401b-4395-b68d-fad34b249856 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.181090 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef116fb-401b-4395-b68d-fad34b249856 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.193562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 57/115] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:55.193562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef116fb-401b-4395-b68d-fad34b249856 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.200765 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eda3618-9403-48bb-a2c8-e06b9e335599 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.205624 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:55.235533 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d53df2-ac51-4f6a-9ab3-108f0d841984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.236141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d53df2-ac51-4f6a-9ab3-108f0d841984 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.236476 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d53df2-ac51-4f6a-9ab3-108f0d841984 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.236747 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d53df2-ac51-4f6a-9ab3-108f0d841984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.293897 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef116fb-401b-4395-b68d-fad34b249856 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.305708 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d53df2-ac51-4f6a-9ab3-108f0d841984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.307182 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d53df2-ac51-4f6a-9ab3-108f0d841984 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.326474 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5241a0-d0ce-4241-b3b9-fc360d0fb536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.327076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5241a0-d0ce-4241-b3b9-fc360d0fb536 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.327378 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5241a0-d0ce-4241-b3b9-fc360d0fb536 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.327647 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a5241a0-d0ce-4241-b3b9-fc360d0fb536 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.328368 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5241a0-d0ce-4241-b3b9-fc360d0fb536 None admin] RBAC: Adding query filter params (role.id=7fb86065b4ef4b98873a590a9c66cfdc, scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd, user.id=f2fce337ce4a417ea9044d0fbc87d49f) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:55.328667 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5241a0-d0ce-4241-b3b9-fc360d0fb536 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.330094 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a5241a0-d0ce-4241-b3b9-fc360d0fb536 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.338569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 58/116] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/role_assignments?user.id=f2fce337ce4a417ea9044d0fbc87d49f&scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd&role.id=7fb86065b4ef4b98873a590a9c66cfdc => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:55.339376 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5241a0-d0ce-4241-b3b9-fc360d0fb536 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.366521 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:55.432439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 59/117] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:30:55.433191 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d53df2-ac51-4f6a-9ab3-108f0d841984 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.437145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:55.469948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a5241a0-d0ce-4241-b3b9-fc360d0fb536 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.510291 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfb21e-e448-49f9-82a7-81f6ed5d9cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.511048 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb21e-e448-49f9-82a7-81f6ed5d9cb8 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.511352 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb21e-e448-49f9-82a7-81f6ed5d9cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.511625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bfb21e-e448-49f9-82a7-81f6ed5d9cb8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.512783 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfb21e-e448-49f9-82a7-81f6ed5d9cb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.514235 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5bfb21e-e448-49f9-82a7-81f6ed5d9cb8 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.516192 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 59/118] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:55.521469 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfb21e-e448-49f9-82a7-81f6ed5d9cb8 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.543246 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d53df2-ac51-4f6a-9ab3-108f0d841984 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.582006 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7905d0e-1821-4c8d-b0c1-af4329e8c605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.582642 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7905d0e-1821-4c8d-b0c1-af4329e8c605 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.582923 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7905d0e-1821-4c8d-b0c1-af4329e8c605 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.583197 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7905d0e-1821-4c8d-b0c1-af4329e8c605 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.583897 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7905d0e-1821-4c8d-b0c1-af4329e8c605 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:55.584201 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7905d0e-1821-4c8d-b0c1-af4329e8c605 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.585666 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7905d0e-1821-4c8d-b0c1-af4329e8c605 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.594924 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 60/119] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:55.600257 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7905d0e-1821-4c8d-b0c1-af4329e8c605 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.613764 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:55.639602 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bfb21e-e448-49f9-82a7-81f6ed5d9cb8 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.672165 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb1c74-b041-4560-b93c-e678539d30bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.672698 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb1c74-b041-4560-b93c-e678539d30bd None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.672975 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb1c74-b041-4560-b93c-e678539d30bd None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.673249 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb1c74-b041-4560-b93c-e678539d30bd None admin] PATH_INFO: `/v3/users/fa13cec188244763b5255c20594ee3b2` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.674363 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb1c74-b041-4560-b93c-e678539d30bd None admin] RBAC: Authorizing `identity:get_user(user_id=fa13cec188244763b5255c20594ee3b2)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.675853 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb1c74-b041-4560-b93c-e678539d30bd None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.677411 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 60/120] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/users/fa13cec188244763b5255c20594ee3b2 => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:55.678138 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb1c74-b041-4560-b93c-e678539d30bd None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.690236 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:55.708179 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7905d0e-1821-4c8d-b0c1-af4329e8c605 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.740753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab8fb9-7a8b-4cc8-bfb8-3b568951579c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.741406 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab8fb9-7a8b-4cc8-bfb8-3b568951579c None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.741685 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab8fb9-7a8b-4cc8-bfb8-3b568951579c None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.741941 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ab8fb9-7a8b-4cc8-bfb8-3b568951579c None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.743043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab8fb9-7a8b-4cc8-bfb8-3b568951579c None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.744528 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ab8fb9-7a8b-4cc8-bfb8-3b568951579c None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.746151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 61/121] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:55.751204 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab8fb9-7a8b-4cc8-bfb8-3b568951579c None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.776928 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb1c74-b041-4560-b93c-e678539d30bd None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.810084 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e056a-e6d3-4463-a9fc-2996864d2917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.810679 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e056a-e6d3-4463-a9fc-2996864d2917 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.810967 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e056a-e6d3-4463-a9fc-2996864d2917 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.811228 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e056a-e6d3-4463-a9fc-2996864d2917 None admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.812012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e056a-e6d3-4463-a9fc-2996864d2917 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.813449 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e056a-e6d3-4463-a9fc-2996864d2917 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.830771 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:55.840070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 61/122] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:30:55 2022] POST /identity/v3/projects => generated 302 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:55.841424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e056a-e6d3-4463-a9fc-2996864d2917 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.879423 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ab8fb9-7a8b-4cc8-bfb8-3b568951579c None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:55.916193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:55.916576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ebd64-c68c-4e8e-8b6f-68d4e82cf064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:55.917279 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ebd64-c68c-4e8e-8b6f-68d4e82cf064 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:55.917618 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ebd64-c68c-4e8e-8b6f-68d4e82cf064 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:55.918112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ebd64-c68c-4e8e-8b6f-68d4e82cf064 None admin] PATH_INFO: `/v3/users/6c5f9b8c2bcb4ea1a2d5f6c3528b8264` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:55.934030 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ebd64-c68c-4e8e-8b6f-68d4e82cf064 None admin] RBAC: Authorizing `identity:get_user(user_id=6c5f9b8c2bcb4ea1a2d5f6c3528b8264)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:55.935549 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ebd64-c68c-4e8e-8b6f-68d4e82cf064 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:55.937287 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 62/123] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/users/6c5f9b8c2bcb4ea1a2d5f6c3528b8264 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:55.943154 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ebd64-c68c-4e8e-8b6f-68d4e82cf064 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:55.963802 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e056a-e6d3-4463-a9fc-2996864d2917 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:56.009946 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b913b89-17bb-4436-90cd-87d113e6b3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:56.010748 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913b89-17bb-4436-90cd-87d113e6b3ae None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:56.011028 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913b89-17bb-4436-90cd-87d113e6b3ae None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:56.011668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b913b89-17bb-4436-90cd-87d113e6b3ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:56.053680 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ebd64-c68c-4e8e-8b6f-68d4e82cf064 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:56.090269 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b913b89-17bb-4436-90cd-87d113e6b3ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:56.091925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b913b89-17bb-4436-90cd-87d113e6b3ae None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:56.093261 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de364da-b26a-4938-aa87-f45581ceb274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:56.093886 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de364da-b26a-4938-aa87-f45581ceb274 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:56.094164 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de364da-b26a-4938-aa87-f45581ceb274 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:56.094430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de364da-b26a-4938-aa87-f45581ceb274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:56.095147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de364da-b26a-4938-aa87-f45581ceb274 None admin] RBAC: Adding query filter params (role.id=717e33c007ba49a5af257abafa205f0f, scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd, user.id=fa13cec188244763b5255c20594ee3b2) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:56.095522 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de364da-b26a-4938-aa87-f45581ceb274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:56.098046 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de364da-b26a-4938-aa87-f45581ceb274 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:56.099854 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:56.103697 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 63/124] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/role_assignments?user.id=fa13cec188244763b5255c20594ee3b2&scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd&role.id=717e33c007ba49a5af257abafa205f0f => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:56.104347 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de364da-b26a-4938-aa87-f45581ceb274 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:56.188748 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:56.243879 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de364da-b26a-4938-aa87-f45581ceb274 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:56.250188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 62/125] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:30:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:30:56.257965 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b913b89-17bb-4436-90cd-87d113e6b3ae None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:56.288259 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81444375-1710-4b67-bc94-de27ef503598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:56.288912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81444375-1710-4b67-bc94-de27ef503598 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:56.289349 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81444375-1710-4b67-bc94-de27ef503598 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:56.289725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81444375-1710-4b67-bc94-de27ef503598 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:56.291582 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81444375-1710-4b67-bc94-de27ef503598 None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:56.293585 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81444375-1710-4b67-bc94-de27ef503598 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:56.296060 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 64/126] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:30:56 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:56.302007 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81444375-1710-4b67-bc94-de27ef503598 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:56.382726 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:56.384020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b913b89-17bb-4436-90cd-87d113e6b3ae None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:56.431019 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81444375-1710-4b67-bc94-de27ef503598 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:56.431237 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e53fa8-a334-4399-9f7c-4875e806b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:56.432073 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53fa8-a334-4399-9f7c-4875e806b433 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:56.432490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53fa8-a334-4399-9f7c-4875e806b433 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:56.433166 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e53fa8-a334-4399-9f7c-4875e806b433 None admin] PATH_INFO: `/v3/projects/e31f3a2e4bcc4c1a9f0d016e4626c7d9` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:56.437198 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e53fa8-a334-4399-9f7c-4875e806b433 None admin] RBAC: Authorizing `identity:get_project(project_id=e31f3a2e4bcc4c1a9f0d016e4626c7d9)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:56.437491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e53fa8-a334-4399-9f7c-4875e806b433 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:56.441392 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 63/127] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:30:56 2022] GET /identity/v3/projects/e31f3a2e4bcc4c1a9f0d016e4626c7d9 => generated 312 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:30:56.445124 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e53fa8-a334-4399-9f7c-4875e806b433 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:56.469524 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c972a3a-2894-4ccc-b684-331386cc79a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:56.470427 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c972a3a-2894-4ccc-b684-331386cc79a9 None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:56.470703 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c972a3a-2894-4ccc-b684-331386cc79a9 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:56.470980 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c972a3a-2894-4ccc-b684-331386cc79a9 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/users/6c5f9b8c2bcb4ea1a2d5f6c3528b8264/roles/30f9bb25296e4cc3b8956272e117845e` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:56.472941 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c972a3a-2894-4ccc-b684-331386cc79a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d64a8a99b0dd46f0beb4750f34503fcd, user_id=6c5f9b8c2bcb4ea1a2d5f6c3528b8264, role_id=30f9bb25296e4cc3b8956272e117845e)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:56.474414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c972a3a-2894-4ccc-b684-331386cc79a9 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:56.477123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:56.490941 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 65/128] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:30:56 2022] PUT /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/users/6c5f9b8c2bcb4ea1a2d5f6c3528b8264/roles/30f9bb25296e4cc3b8956272e117845e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:30:56.554616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e53fa8-a334-4399-9f7c-4875e806b433 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:56.595078 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80483d-7ad0-4d8b-b8e6-3858b1e480be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:56.596015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80483d-7ad0-4d8b-b8e6-3858b1e480be None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:56.596488 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80483d-7ad0-4d8b-b8e6-3858b1e480be None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:56.596926 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80483d-7ad0-4d8b-b8e6-3858b1e480be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:56.597867 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80483d-7ad0-4d8b-b8e6-3858b1e480be None admin] RBAC: Adding query filter params (role.id=72c390b29d3240dd8c46b0fd1b18441e, scope.project.id=e31f3a2e4bcc4c1a9f0d016e4626c7d9, user.id=fa13cec188244763b5255c20594ee3b2) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:56.598312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80483d-7ad0-4d8b-b8e6-3858b1e480be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:56.600010 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80483d-7ad0-4d8b-b8e6-3858b1e480be None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:56.607420 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 64/129] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:30:56 2022] GET /identity/v3/role_assignments?user.id=fa13cec188244763b5255c20594ee3b2&scope.project.id=e31f3a2e4bcc4c1a9f0d016e4626c7d9&role.id=72c390b29d3240dd8c46b0fd1b18441e => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:30:58.284011 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f03cb-9992-4c32-ad19-68407dfd1550 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:58.284614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f03cb-9992-4c32-ad19-68407dfd1550 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:58.284614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f03cb-9992-4c32-ad19-68407dfd1550 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:58.285853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 66/130] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:30:58.292587 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8562bc6-71cd-474e-9763-b6494d5ae67e None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:58.293014 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8562bc6-71cd-474e-9763-b6494d5ae67e None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:58.293155 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8562bc6-71cd-474e-9763-b6494d5ae67e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:58.312504 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-b8562bc6-71cd-474e-9763-b6494d5ae67e None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:58.313682 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-b8562bc6-71cd-474e-9763-b6494d5ae67e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:58.389176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 65/131] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:30:58.712420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f03cb-9992-4c32-ad19-68407dfd1550 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:58.815885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f03cb-9992-4c32-ad19-68407dfd1550 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:58.842721 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:58.844999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7841c18-e823-4e3b-b535-783ed80468b4 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:58.845253 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7841c18-e823-4e3b-b535-783ed80468b4 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:58.845500 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7841c18-e823-4e3b-b535-783ed80468b4 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:58.846871 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 66/132] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:30:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:30:58.852098 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91dc38-c546-4509-9d16-61eece1a4301 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:58.852385 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91dc38-c546-4509-9d16-61eece1a4301 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:58.852494 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd63e6-182d-4726-828e-2bfcff29e804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:58.852662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91dc38-c546-4509-9d16-61eece1a4301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:58.853068 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd63e6-182d-4726-828e-2bfcff29e804 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:58.853352 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd63e6-182d-4726-828e-2bfcff29e804 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:58.853622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd63e6-182d-4726-828e-2bfcff29e804 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:58.855104 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd63e6-182d-4726-828e-2bfcff29e804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:58.856606 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd63e6-182d-4726-828e-2bfcff29e804 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:58.858161 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 67/133] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:30:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:58.863525 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd63e6-182d-4726-828e-2bfcff29e804 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:58.870776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-6a91dc38-c546-4509-9d16-61eece1a4301 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:30:58.872000 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-6a91dc38-c546-4509-9d16-61eece1a4301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:30:58.889485 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:58.937311 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 67/134] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:30:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:30:58.961648 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd63e6-182d-4726-828e-2bfcff29e804 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:58.998239 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034b9d3-cba8-4655-a3ba-d54ae0cd8be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:58.998794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034b9d3-cba8-4655-a3ba-d54ae0cd8be0 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:58.999095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034b9d3-cba8-4655-a3ba-d54ae0cd8be0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:58.999416 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d034b9d3-cba8-4655-a3ba-d54ae0cd8be0 None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:59.000073 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034b9d3-cba8-4655-a3ba-d54ae0cd8be0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:59.001532 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d034b9d3-cba8-4655-a3ba-d54ae0cd8be0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:59.029979 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 68/135] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:30:58 2022] POST /identity/v3/users => generated 283 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:30:59.260851 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91dc38-c546-4509-9d16-61eece1a4301 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:59.362468 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a91dc38-c546-4509-9d16-61eece1a4301 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:59.399590 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca16d9-d083-4097-8c91-be8f0272cccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:59.400240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca16d9-d083-4097-8c91-be8f0272cccd None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:59.400520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca16d9-d083-4097-8c91-be8f0272cccd None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:59.400789 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ca16d9-d083-4097-8c91-be8f0272cccd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:59.415281 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ca16d9-d083-4097-8c91-be8f0272cccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-64ca16d9-d083-4097-8c91-be8f0272cccd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:30:59.421145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:30:59.422175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:30:59.423002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 68/136] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:30:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:30:59.430098 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034b9d3-cba8-4655-a3ba-d54ae0cd8be0 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:59.489519 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:59.538770 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d034b9d3-cba8-4655-a3ba-d54ae0cd8be0 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:59.574369 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587a046-35d7-472c-8a88-1943abeb5065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:59.574987 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587a046-35d7-472c-8a88-1943abeb5065 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:59.575282 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587a046-35d7-472c-8a88-1943abeb5065 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:59.575568 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d587a046-35d7-472c-8a88-1943abeb5065 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:59.576238 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587a046-35d7-472c-8a88-1943abeb5065 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:30:59.576541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587a046-35d7-472c-8a88-1943abeb5065 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:59.577938 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d587a046-35d7-472c-8a88-1943abeb5065 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:59.587306 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 69/137] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:30:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:30:59.592847 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca16d9-d083-4097-8c91-be8f0272cccd None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:59.609611 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:59.697198 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ca16d9-d083-4097-8c91-be8f0272cccd None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:59.732170 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b6d2a-7ddc-447a-a5a1-13f99bcc1966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:59.733069 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b6d2a-7ddc-447a-a5a1-13f99bcc1966 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:59.733495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b6d2a-7ddc-447a-a5a1-13f99bcc1966 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:59.733907 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90b6d2a-7ddc-447a-a5a1-13f99bcc1966 None admin] PATH_INFO: `/v3/users/6c5f9b8c2bcb4ea1a2d5f6c3528b8264` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:59.735181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b6d2a-7ddc-447a-a5a1-13f99bcc1966 None admin] RBAC: Authorizing `identity:get_user(user_id=6c5f9b8c2bcb4ea1a2d5f6c3528b8264)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:59.736796 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90b6d2a-7ddc-447a-a5a1-13f99bcc1966 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:30:59.738880 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 69/138] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:30:59 2022] GET /identity/v3/users/6c5f9b8c2bcb4ea1a2d5f6c3528b8264 => generated 289 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:30:59.744244 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587a046-35d7-472c-8a88-1943abeb5065 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:30:59.851748 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d587a046-35d7-472c-8a88-1943abeb5065 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:30:59.868048 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:30:59.891520 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1e93a-8a3d-47d9-955b-f4d2f4f40959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:30:59.892122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1e93a-8a3d-47d9-955b-f4d2f4f40959 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:30:59.892397 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1e93a-8a3d-47d9-955b-f4d2f4f40959 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:30:59.892662 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f1e93a-8a3d-47d9-955b-f4d2f4f40959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:30:59.961106 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1e93a-8a3d-47d9-955b-f4d2f4f40959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:30:59.962586 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f1e93a-8a3d-47d9-955b-f4d2f4f40959 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:00.069811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 70/139] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:30:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:00.075730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b6d2a-7ddc-447a-a5a1-13f99bcc1966 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:00.160366 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:00.178752 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90b6d2a-7ddc-447a-a5a1-13f99bcc1966 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:00.212130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54c596-ebdc-40bd-8374-7eff02925c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:00.213057 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54c596-ebdc-40bd-8374-7eff02925c4e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:00.213567 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54c596-ebdc-40bd-8374-7eff02925c4e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:00.214030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54c596-ebdc-40bd-8374-7eff02925c4e None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:00.215385 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54c596-ebdc-40bd-8374-7eff02925c4e None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:00.217023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54c596-ebdc-40bd-8374-7eff02925c4e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:00.218833 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 70/140] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:00 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:00.225195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1e93a-8a3d-47d9-955b-f4d2f4f40959 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:00.241311 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:00.332189 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f1e93a-8a3d-47d9-955b-f4d2f4f40959 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:00.368167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49610230-317d-468b-82e1-f5a173c6f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:00.368824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49610230-317d-468b-82e1-f5a173c6f037 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:00.369123 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49610230-317d-468b-82e1-f5a173c6f037 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:00.369415 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49610230-317d-468b-82e1-f5a173c6f037 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:00.370138 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49610230-317d-468b-82e1-f5a173c6f037 None admin] RBAC: Adding query filter params (role.id=30f9bb25296e4cc3b8956272e117845e, scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd, user.id=6c5f9b8c2bcb4ea1a2d5f6c3528b8264) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:00.370445 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49610230-317d-468b-82e1-f5a173c6f037 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:00.371993 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49610230-317d-468b-82e1-f5a173c6f037 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:00.378022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 71/141] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:00 2022] GET /identity/v3/role_assignments?user.id=6c5f9b8c2bcb4ea1a2d5f6c3528b8264&scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd&role.id=30f9bb25296e4cc3b8956272e117845e => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:01.568750 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b6d99-1ead-4c9f-88f4-46bc87a1071a None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:01.569311 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b6d99-1ead-4c9f-88f4-46bc87a1071a None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:01.569311 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0b6d99-1ead-4c9f-88f4-46bc87a1071a None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:01.570597 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 71/142] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:01.575973 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad296d1-e650-43a2-a2af-218c97b63ca7 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:01.576366 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad296d1-e650-43a2-a2af-218c97b63ca7 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:01.576599 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad296d1-e650-43a2-a2af-218c97b63ca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:01.595978 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-2ad296d1-e650-43a2-a2af-218c97b63ca7 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:01.597180 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-2ad296d1-e650-43a2-a2af-218c97b63ca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:01.671380 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 72/143] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:01.756258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf337f9-992f-48c5-87cc-e798931a6aac None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:01.756537 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf337f9-992f-48c5-87cc-e798931a6aac None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:01.756991 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf337f9-992f-48c5-87cc-e798931a6aac None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:01.757103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cc2a4-257a-4c96-b5ad-de38fa6ac131 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:01.757355 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cc2a4-257a-4c96-b5ad-de38fa6ac131 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:01.757630 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80cc2a4-257a-4c96-b5ad-de38fa6ac131 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:01.758315 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 72/144] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:01.759163 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 73/145] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:01.763429 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e63e2-58a9-4185-b953-990e8c60b715 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:01.763718 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e63e2-58a9-4185-b953-990e8c60b715 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:01.763984 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efae16-12f1-438e-9978-e63efa8373f0 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:01.764080 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932e63e2-58a9-4185-b953-990e8c60b715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:01.764272 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efae16-12f1-438e-9978-e63efa8373f0 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:01.764548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0efae16-12f1-438e-9978-e63efa8373f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:01.782434 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-932e63e2-58a9-4185-b953-990e8c60b715 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:01.783652 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-932e63e2-58a9-4185-b953-990e8c60b715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:01.783976 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-b0efae16-12f1-438e-9978-e63efa8373f0 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:01.785225 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-b0efae16-12f1-438e-9978-e63efa8373f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:01.787167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:01.853849 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 73/146] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:01.866673 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 74/147] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:01.990721 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e63e2-58a9-4185-b953-990e8c60b715 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.072855 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:02.094084 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932e63e2-58a9-4185-b953-990e8c60b715 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.128116 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7a451-b25b-4e49-8f4e-0a10b3740a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.128742 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a451-b25b-4e49-8f4e-0a10b3740a02 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.129019 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a451-b25b-4e49-8f4e-0a10b3740a02 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.129287 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7a451-b25b-4e49-8f4e-0a10b3740a02 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.139513 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7a451-b25b-4e49-8f4e-0a10b3740a02 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-d6c7a451-b25b-4e49-8f4e-0a10b3740a02 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:02.144279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:02.145111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:02.146070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:02.147597 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 74/148] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:31:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:02.151427 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efae16-12f1-438e-9978-e63efa8373f0 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.172058 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7a451-b25b-4e49-8f4e-0a10b3740a02 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.251479 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0efae16-12f1-438e-9978-e63efa8373f0 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.269348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7a451-b25b-4e49-8f4e-0a10b3740a02 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.286238 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb72861-d9f3-4acb-b9fd-42ae0d3dba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.286848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb72861-d9f3-4acb-b9fd-42ae0d3dba73 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.287096 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb72861-d9f3-4acb-b9fd-42ae0d3dba73 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.287392 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb72861-d9f3-4acb-b9fd-42ae0d3dba73 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.288068 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb72861-d9f3-4acb-b9fd-42ae0d3dba73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:02.288367 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb72861-d9f3-4acb-b9fd-42ae0d3dba73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:02.289781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb72861-d9f3-4acb-b9fd-42ae0d3dba73 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:02.294815 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:02.298428 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 75/149] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:02.299361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb72861-d9f3-4acb-b9fd-42ae0d3dba73 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.303122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06212964-4b82-4a32-b423-7b2dc31208de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.303874 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06212964-4b82-4a32-b423-7b2dc31208de None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.304149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06212964-4b82-4a32-b423-7b2dc31208de None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.304413 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06212964-4b82-4a32-b423-7b2dc31208de None admin] PATH_INFO: `/v3/domains/default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.305510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06212964-4b82-4a32-b423-7b2dc31208de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:02.306955 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06212964-4b82-4a32-b423-7b2dc31208de None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:02.311291 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 75/150] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:02.311291 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06212964-4b82-4a32-b423-7b2dc31208de None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.321032 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:02.412950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb72861-d9f3-4acb-b9fd-42ae0d3dba73 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.416660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06212964-4b82-4a32-b423-7b2dc31208de None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.446649 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf09c3-3c67-42bc-bc84-9027e0bb63d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.447283 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf09c3-3c67-42bc-bc84-9027e0bb63d2 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.447570 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf09c3-3c67-42bc-bc84-9027e0bb63d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.447836 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bf09c3-3c67-42bc-bc84-9027e0bb63d2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.449098 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e9c7e-db46-4c27-a0aa-ae99d07e498b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.449730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e9c7e-db46-4c27-a0aa-ae99d07e498b None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.450004 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e9c7e-db46-4c27-a0aa-ae99d07e498b None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.450268 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e9c7e-db46-4c27-a0aa-ae99d07e498b None admin] PATH_INFO: `/v3/users/e79a002b00ad4113b7085b364cc3f24a` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.457880 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bf09c3-3c67-42bc-bc84-9027e0bb63d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-86bf09c3-3c67-42bc-bc84-9027e0bb63d2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:02.463540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:02.464655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:02.465454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 76/151] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:31:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:02.466088 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf09c3-3c67-42bc-bc84-9027e0bb63d2 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.467348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e9c7e-db46-4c27-a0aa-ae99d07e498b None admin] RBAC: Authorizing `identity:get_user(user_id=e79a002b00ad4113b7085b364cc3f24a)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:02.468997 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e9c7e-db46-4c27-a0aa-ae99d07e498b None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:02.470669 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 76/152] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:02 2022] GET /identity/v3/users/e79a002b00ad4113b7085b364cc3f24a => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:02.471462 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e9c7e-db46-4c27-a0aa-ae99d07e498b None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.524662 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:02.538068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:02.564988 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bf09c3-3c67-42bc-bc84-9027e0bb63d2 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.571428 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e9c7e-db46-4c27-a0aa-ae99d07e498b None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.600047 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35127-598f-4583-aa69-65d03a05cf33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.600655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35127-598f-4583-aa69-65d03a05cf33 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.600926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35127-598f-4583-aa69-65d03a05cf33 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.601189 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f35127-598f-4583-aa69-65d03a05cf33 None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.601832 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f35127-598f-4583-aa69-65d03a05cf33 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:02.603282 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f35127-598f-4583-aa69-65d03a05cf33 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:02.606188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af4b7b-6c88-4662-abeb-78e9e9b1a7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.606793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af4b7b-6c88-4662-abeb-78e9e9b1a7ca None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.607073 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af4b7b-6c88-4662-abeb-78e9e9b1a7ca None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.607372 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41af4b7b-6c88-4662-abeb-78e9e9b1a7ca None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.608037 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af4b7b-6c88-4662-abeb-78e9e9b1a7ca None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:02.608336 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af4b7b-6c88-4662-abeb-78e9e9b1a7ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:02.609689 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41af4b7b-6c88-4662-abeb-78e9e9b1a7ca None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:02.617706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 77/153] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:02.618508 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af4b7b-6c88-4662-abeb-78e9e9b1a7ca None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.627294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 77/154] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:31:02 2022] POST /identity/v3/users => generated 297 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:31:02.627294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35127-598f-4583-aa69-65d03a05cf33 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.740803 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41af4b7b-6c88-4662-abeb-78e9e9b1a7ca None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.745220 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f35127-598f-4583-aa69-65d03a05cf33 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.766111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:02.769535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:02.779239 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac0893-1516-4218-a36e-28fc58b67512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.779781 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac0893-1516-4218-a36e-28fc58b67512 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.780058 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac0893-1516-4218-a36e-28fc58b67512 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.780333 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac0893-1516-4218-a36e-28fc58b67512 None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.781495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac0893-1516-4218-a36e-28fc58b67512 None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:02.782949 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac0893-1516-4218-a36e-28fc58b67512 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:02.784800 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 78/155] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:02 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:02.790608 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac0893-1516-4218-a36e-28fc58b67512 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.791744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8c0a8-f51e-4519-a38e-5c6b8653990e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.792396 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8c0a8-f51e-4519-a38e-5c6b8653990e None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.792670 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8c0a8-f51e-4519-a38e-5c6b8653990e None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.792935 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d8c0a8-f51e-4519-a38e-5c6b8653990e None admin] PATH_INFO: `/v3/users/e79a002b00ad4113b7085b364cc3f24a` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.794146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8c0a8-f51e-4519-a38e-5c6b8653990e None admin] RBAC: Authorizing `identity:get_user(user_id=e79a002b00ad4113b7085b364cc3f24a)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:02.795772 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d8c0a8-f51e-4519-a38e-5c6b8653990e None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:02.797572 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 78/156] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:02 2022] GET /identity/v3/users/e79a002b00ad4113b7085b364cc3f24a => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:02.803294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8c0a8-f51e-4519-a38e-5c6b8653990e None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:02.902022 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac0893-1516-4218-a36e-28fc58b67512 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.920355 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d8c0a8-f51e-4519-a38e-5c6b8653990e None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:02.950462 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1873afda-9adb-4d20-9184-7d1cef74631a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.951209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873afda-9adb-4d20-9184-7d1cef74631a None admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.951577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873afda-9adb-4d20-9184-7d1cef74631a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.951873 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1873afda-9adb-4d20-9184-7d1cef74631a None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850/users/e79a002b00ad4113b7085b364cc3f24a/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.953857 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873afda-9adb-4d20-9184-7d1cef74631a None admin] RBAC: Authorizing `identity:create_grant(project_id=eadc8205943c46cfaec67ba17ede1850, user_id=e79a002b00ad4113b7085b364cc3f24a, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:02.955434 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1873afda-9adb-4d20-9184-7d1cef74631a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:02.960263 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70ee59-592a-4b6f-bb64-9a94f9ebcd9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:02.960902 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ee59-592a-4b6f-bb64-9a94f9ebcd9d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:02.961173 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ee59-592a-4b6f-bb64-9a94f9ebcd9d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:02.961443 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc70ee59-592a-4b6f-bb64-9a94f9ebcd9d None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:02.963861 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70ee59-592a-4b6f-bb64-9a94f9ebcd9d None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:02.965394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc70ee59-592a-4b6f-bb64-9a94f9ebcd9d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:02.967433 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 79/157] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:02 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:02.972829 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 79/158] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:31:02 2022] PUT /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850/users/e79a002b00ad4113b7085b364cc3f24a/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:31:02.972962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70ee59-592a-4b6f-bb64-9a94f9ebcd9d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:03.039805 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:03.094571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc70ee59-592a-4b6f-bb64-9a94f9ebcd9d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:03.132425 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82430cc6-434a-4836-b264-366bf9352036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:03.133107 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430cc6-434a-4836-b264-366bf9352036 None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:03.133386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430cc6-434a-4836-b264-366bf9352036 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:03.133710 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82430cc6-434a-4836-b264-366bf9352036 None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850/users/e79a002b00ad4113b7085b364cc3f24a/roles/717e33c007ba49a5af257abafa205f0f` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:03.136032 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82430cc6-434a-4836-b264-366bf9352036 None admin] RBAC: Authorizing `identity:create_grant(project_id=eadc8205943c46cfaec67ba17ede1850, user_id=e79a002b00ad4113b7085b364cc3f24a, role_id=717e33c007ba49a5af257abafa205f0f)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:03.137676 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82430cc6-434a-4836-b264-366bf9352036 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:03.154712 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 80/159] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:31:02 2022] PUT /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850/users/e79a002b00ad4113b7085b364cc3f24a/roles/717e33c007ba49a5af257abafa205f0f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:31:05.171958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d21443-8f0b-4daf-8921-d973ae0e943d None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.172508 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d21443-8f0b-4daf-8921-d973ae0e943d None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.172584 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d21443-8f0b-4daf-8921-d973ae0e943d None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.173932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 80/160] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:05.179228 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca86fc3-9b96-476f-93d4-afcc94ba64fe None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.180051 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca86fc3-9b96-476f-93d4-afcc94ba64fe None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.180546 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca86fc3-9b96-476f-93d4-afcc94ba64fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.199304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-0ca86fc3-9b96-476f-93d4-afcc94ba64fe None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:05.200831 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-0ca86fc3-9b96-476f-93d4-afcc94ba64fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:05.230428 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b62ac0-731f-4b9a-a417-791f5fbb43af None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.231034 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b62ac0-731f-4b9a-a417-791f5fbb43af None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.231552 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b62ac0-731f-4b9a-a417-791f5fbb43af None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.233350 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 81/161] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:05.240106 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85948e74-3168-4784-bcf7-0d7723d5f9e1 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.240722 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85948e74-3168-4784-bcf7-0d7723d5f9e1 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.241189 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85948e74-3168-4784-bcf7-0d7723d5f9e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.260537 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-85948e74-3168-4784-bcf7-0d7723d5f9e1 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:05.262030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-85948e74-3168-4784-bcf7-0d7723d5f9e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:05.271309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 81/162] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:05.318825 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:05.340974 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 82/163] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:05.370516 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c854e-7f21-4c79-a2fd-953e186a3a8e None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.370795 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c854e-7f21-4c79-a2fd-953e186a3a8e None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.371063 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c854e-7f21-4c79-a2fd-953e186a3a8e None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.372493 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 82/164] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:05.377813 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183101b-fd8a-4e4a-b46c-f095762573c3 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.378243 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183101b-fd8a-4e4a-b46c-f095762573c3 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.378666 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7183101b-fd8a-4e4a-b46c-f095762573c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.397290 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-7183101b-fd8a-4e4a-b46c-f095762573c3 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:05.398470 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-7183101b-fd8a-4e4a-b46c-f095762573c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:05.468857 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 83/165] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:05.599878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c854e-7f21-4c79-a2fd-953e186a3a8e None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:05.613781 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ac870-061a-4c7b-9ef7-99093ab4c329 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.614076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ac870-061a-4c7b-9ef7-99093ab4c329 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.614326 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19ac870-061a-4c7b-9ef7-99093ab4c329 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.615718 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 84/166] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:31:05.621363 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a12d95-e487-4200-85be-99dc73d97708 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.621901 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a12d95-e487-4200-85be-99dc73d97708 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.622370 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a12d95-e487-4200-85be-99dc73d97708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.648648 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-66a12d95-e487-4200-85be-99dc73d97708 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:05.650126 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-66a12d95-e487-4200-85be-99dc73d97708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:05.654565 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:05.717851 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c854e-7f21-4c79-a2fd-953e186a3a8e None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:05.724514 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 85/167] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:05.725574 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a12d95-e487-4200-85be-99dc73d97708 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:05.758824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a3644-6822-4e95-bed8-ba224c13f41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:05.759804 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a3644-6822-4e95-bed8-ba224c13f41e None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.760334 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a3644-6822-4e95-bed8-ba224c13f41e None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.760788 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a3644-6822-4e95-bed8-ba224c13f41e None admin] PATH_INFO: `/v3/roles/member` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.772207 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a3644-6822-4e95-bed8-ba224c13f41e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-aa6a3644-6822-4e95-bed8-ba224c13f41e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:05.778003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:05.778929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:05.779722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:05.781642 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:05.783501 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 83/168] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:05.794135 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a3644-6822-4e95-bed8-ba224c13f41e None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:05.831187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a12d95-e487-4200-85be-99dc73d97708 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:05.865713 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f761787-151c-4431-9876-acf70a316700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:05.866343 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f761787-151c-4431-9876-acf70a316700 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.866613 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f761787-151c-4431-9876-acf70a316700 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.866877 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f761787-151c-4431-9876-acf70a316700 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.868629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f761787-151c-4431-9876-acf70a316700 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:05.869431 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f761787-151c-4431-9876-acf70a316700 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:05.871140 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 86/169] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:05.876395 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f761787-151c-4431-9876-acf70a316700 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:05.898043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a3644-6822-4e95-bed8-ba224c13f41e None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:05.899662 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:05.933839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a7111-89e9-49f1-86b9-aeb403551f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:05.934394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a7111-89e9-49f1-86b9-aeb403551f8d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:05.934696 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a7111-89e9-49f1-86b9-aeb403551f8d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:05.934931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a7111-89e9-49f1-86b9-aeb403551f8d None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:05.935640 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a7111-89e9-49f1-86b9-aeb403551f8d None admin] RBAC: Adding query filter params (name=member) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:05.935933 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a7111-89e9-49f1-86b9-aeb403551f8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:05.937333 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a7111-89e9-49f1-86b9-aeb403551f8d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:05.950729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 84/170] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:05.950729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a7111-89e9-49f1-86b9-aeb403551f8d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:05.993338 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f761787-151c-4431-9876-acf70a316700 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.007294 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:06.030952 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fffc9e-951d-45e2-a0ea-a1311dde233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.031579 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fffc9e-951d-45e2-a0ea-a1311dde233f None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.031853 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fffc9e-951d-45e2-a0ea-a1311dde233f None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.032371 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fffc9e-951d-45e2-a0ea-a1311dde233f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.042931 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9fffc9e-951d-45e2-a0ea-a1311dde233f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-d9fffc9e-951d-45e2-a0ea-a1311dde233f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:06.048146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:06.049018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:06.049776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 87/171] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:31:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:06.050412 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fffc9e-951d-45e2-a0ea-a1311dde233f None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.053067 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a7111-89e9-49f1-86b9-aeb403551f8d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.085223 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41790-74c4-40c6-b838-c9d96f0258ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.085819 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41790-74c4-40c6-b838-c9d96f0258ef None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.086096 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41790-74c4-40c6-b838-c9d96f0258ef None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.086364 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3d41790-74c4-40c6-b838-c9d96f0258ef None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.087001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d41790-74c4-40c6-b838-c9d96f0258ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:06.088478 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3d41790-74c4-40c6-b838-c9d96f0258ef None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:06.109512 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 85/172] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:31:05 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:31:06.110308 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41790-74c4-40c6-b838-c9d96f0258ef None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.136724 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:06.160678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fffc9e-951d-45e2-a0ea-a1311dde233f None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.201373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6f3f-194a-44ef-b936-b32073d27176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.202251 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6f3f-194a-44ef-b936-b32073d27176 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.202534 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6f3f-194a-44ef-b936-b32073d27176 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.202800 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edad6f3f-194a-44ef-b936-b32073d27176 None admin] PATH_INFO: `/v3/users/e539b174637e4aeb9e8ced5baf3b4918` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.218259 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad6f3f-194a-44ef-b936-b32073d27176 None admin] RBAC: Authorizing `identity:get_user(user_id=e539b174637e4aeb9e8ced5baf3b4918)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:06.219814 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edad6f3f-194a-44ef-b936-b32073d27176 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:06.221716 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 88/173] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:06 2022] GET /identity/v3/users/e539b174637e4aeb9e8ced5baf3b4918 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:06.222922 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6f3f-194a-44ef-b936-b32073d27176 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.229440 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3d41790-74c4-40c6-b838-c9d96f0258ef None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.261151 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:06.269753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ae440-3d59-492a-8513-4c3ca5d3cc08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.270675 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ae440-3d59-492a-8513-4c3ca5d3cc08 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.271102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ae440-3d59-492a-8513-4c3ca5d3cc08 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.271548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7ae440-3d59-492a-8513-4c3ca5d3cc08 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.283507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7ae440-3d59-492a-8513-4c3ca5d3cc08 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-ba7ae440-3d59-492a-8513-4c3ca5d3cc08 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:06.288876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:06.289821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 86/174] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:31:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:06.295746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ae440-3d59-492a-8513-4c3ca5d3cc08 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.349464 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edad6f3f-194a-44ef-b936-b32073d27176 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.386415 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:06.396113 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f1ea1-6a41-4007-813a-73ed1805d363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.396770 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f1ea1-6a41-4007-813a-73ed1805d363 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.397643 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f1ea1-6a41-4007-813a-73ed1805d363 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.397916 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263f1ea1-6a41-4007-813a-73ed1805d363 None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.398588 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f1ea1-6a41-4007-813a-73ed1805d363 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:06.398885 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f1ea1-6a41-4007-813a-73ed1805d363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:06.400301 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263f1ea1-6a41-4007-813a-73ed1805d363 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:06.412899 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7ae440-3d59-492a-8513-4c3ca5d3cc08 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.414173 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 89/175] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:06.415001 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f1ea1-6a41-4007-813a-73ed1805d363 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.454332 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b38d18-24ca-4689-a924-ca54cb18a32d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.455450 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38d18-24ca-4689-a924-ca54cb18a32d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.455733 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38d18-24ca-4689-a924-ca54cb18a32d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.456005 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b38d18-24ca-4689-a924-ca54cb18a32d None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.457156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b38d18-24ca-4689-a924-ca54cb18a32d None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:06.458623 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b38d18-24ca-4689-a924-ca54cb18a32d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:06.463294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 87/176] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:06 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:06.463294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b38d18-24ca-4689-a924-ca54cb18a32d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.530873 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:06.540969 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263f1ea1-6a41-4007-813a-73ed1805d363 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.578580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2b687-ca4c-4683-b7df-fba23651e81b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.579185 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2b687-ca4c-4683-b7df-fba23651e81b None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.579643 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2b687-ca4c-4683-b7df-fba23651e81b None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.579910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd2b687-ca4c-4683-b7df-fba23651e81b None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.580972 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2b687-ca4c-4683-b7df-fba23651e81b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:06.581522 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2b687-ca4c-4683-b7df-fba23651e81b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:06.582911 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd2b687-ca4c-4683-b7df-fba23651e81b None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:06.590647 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b38d18-24ca-4689-a924-ca54cb18a32d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.591952 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 90/177] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:06.592733 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2b687-ca4c-4683-b7df-fba23651e81b None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.635679 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44256-0b97-47a1-869b-e11971403714 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.636892 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44256-0b97-47a1-869b-e11971403714 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.637167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44256-0b97-47a1-869b-e11971403714 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.637430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d44256-0b97-47a1-869b-e11971403714 None admin] PATH_INFO: `/v3/users/e79a002b00ad4113b7085b364cc3f24a` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.638994 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44256-0b97-47a1-869b-e11971403714 None admin] RBAC: Authorizing `identity:get_user(user_id=e79a002b00ad4113b7085b364cc3f24a)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:06.641199 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d44256-0b97-47a1-869b-e11971403714 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:06.643326 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 88/178] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:06 2022] GET /identity/v3/users/e79a002b00ad4113b7085b364cc3f24a => generated 283 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:06.644381 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44256-0b97-47a1-869b-e11971403714 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.665268 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:06.714247 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd2b687-ca4c-4683-b7df-fba23651e81b None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.756781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d44256-0b97-47a1-869b-e11971403714 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.758725 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef40f1-374e-4139-a676-388fd9439b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.760328 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef40f1-374e-4139-a676-388fd9439b75 None admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.760604 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef40f1-374e-4139-a676-388fd9439b75 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.760873 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ef40f1-374e-4139-a676-388fd9439b75 None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850/users/e539b174637e4aeb9e8ced5baf3b4918/roles/72c390b29d3240dd8c46b0fd1b18441e` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.762810 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef40f1-374e-4139-a676-388fd9439b75 None admin] RBAC: Authorizing `identity:create_grant(project_id=eadc8205943c46cfaec67ba17ede1850, user_id=e539b174637e4aeb9e8ced5baf3b4918, role_id=72c390b29d3240dd8c46b0fd1b18441e)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:06.764808 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ef40f1-374e-4139-a676-388fd9439b75 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:06.781994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 91/179] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:31:06 2022] PUT /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850/users/e539b174637e4aeb9e8ced5baf3b4918/roles/72c390b29d3240dd8c46b0fd1b18441e => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:31:06.783182 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef40f1-374e-4139-a676-388fd9439b75 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.794854 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b05a3-ba31-4eec-893d-71f3ff1999ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.795656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b05a3-ba31-4eec-893d-71f3ff1999ac None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.796025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b05a3-ba31-4eec-893d-71f3ff1999ac None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.796359 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767b05a3-ba31-4eec-893d-71f3ff1999ac None admin] PATH_INFO: `/v3/users/e79a002b00ad4113b7085b364cc3f24a` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.797578 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b05a3-ba31-4eec-893d-71f3ff1999ac None admin] RBAC: Authorizing `identity:get_user(user_id=e79a002b00ad4113b7085b364cc3f24a)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:06.799277 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767b05a3-ba31-4eec-893d-71f3ff1999ac None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:06.801043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 89/180] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:06 2022] GET /identity/v3/users/e79a002b00ad4113b7085b364cc3f24a => generated 283 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:06.811643 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:06.812941 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b05a3-ba31-4eec-893d-71f3ff1999ac None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:06.905555 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ef40f1-374e-4139-a676-388fd9439b75 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:06.949177 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f2c5e-c137-4d73-8064-131bd1e89cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:06.949843 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f2c5e-c137-4d73-8064-131bd1e89cb2 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:06.950120 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f2c5e-c137-4d73-8064-131bd1e89cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:06.950389 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0f2c5e-c137-4d73-8064-131bd1e89cb2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:06.985739 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:07.012684 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767b05a3-ba31-4eec-893d-71f3ff1999ac None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:07.040598 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f2c5e-c137-4d73-8064-131bd1e89cb2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:07.042106 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0f2c5e-c137-4d73-8064-131bd1e89cb2 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:07.066237 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:07.086327 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb18e0-8a07-4b4f-ad60-79c8c3832985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:07.086989 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb18e0-8a07-4b4f-ad60-79c8c3832985 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:07.087282 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb18e0-8a07-4b4f-ad60-79c8c3832985 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:07.088340 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decb18e0-8a07-4b4f-ad60-79c8c3832985 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:07.164602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb18e0-8a07-4b4f-ad60-79c8c3832985 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:07.165219 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 92/181] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:07.166169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decb18e0-8a07-4b4f-ad60-79c8c3832985 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:07.171763 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f2c5e-c137-4d73-8064-131bd1e89cb2 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:07.256766 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:07.281725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 90/182] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:07.287482 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb18e0-8a07-4b4f-ad60-79c8c3832985 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:07.304290 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0f2c5e-c137-4d73-8064-131bd1e89cb2 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:07.338572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:07.372658 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabae2b-1ba1-49c7-8153-7797b98e611e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:07.373488 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabae2b-1ba1-49c7-8153-7797b98e611e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:07.373758 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabae2b-1ba1-49c7-8153-7797b98e611e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:07.374024 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fabae2b-1ba1-49c7-8153-7797b98e611e None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:07.377066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabae2b-1ba1-49c7-8153-7797b98e611e None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:07.378510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fabae2b-1ba1-49c7-8153-7797b98e611e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:07.382991 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 93/183] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:07 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:07.392599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabae2b-1ba1-49c7-8153-7797b98e611e None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:07.438941 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decb18e0-8a07-4b4f-ad60-79c8c3832985 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:07.475831 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e641a5-057a-4945-96b6-35adc88597fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:07.476456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e641a5-057a-4945-96b6-35adc88597fa None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:07.476727 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e641a5-057a-4945-96b6-35adc88597fa None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:07.476991 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e641a5-057a-4945-96b6-35adc88597fa None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:07.478099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e641a5-057a-4945-96b6-35adc88597fa None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:07.479557 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e641a5-057a-4945-96b6-35adc88597fa None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:07.481595 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 91/184] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:07 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:07.487322 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e641a5-057a-4945-96b6-35adc88597fa None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:07.547621 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:07.612140 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e641a5-057a-4945-96b6-35adc88597fa None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:07.625411 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fabae2b-1ba1-49c7-8153-7797b98e611e None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:07.645976 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c9c1f1-01cb-4c0f-b297-2aeafc0bd7be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:07.646622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9c1f1-01cb-4c0f-b297-2aeafc0bd7be None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:07.646958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9c1f1-01cb-4c0f-b297-2aeafc0bd7be None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:07.647227 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c9c1f1-01cb-4c0f-b297-2aeafc0bd7be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:07.648095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9c1f1-01cb-4c0f-b297-2aeafc0bd7be None admin] RBAC: Adding query filter params (role.id=717e33c007ba49a5af257abafa205f0f, scope.project.id=eadc8205943c46cfaec67ba17ede1850, user.id=e79a002b00ad4113b7085b364cc3f24a) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:07.648400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9c1f1-01cb-4c0f-b297-2aeafc0bd7be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:07.649910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c9c1f1-01cb-4c0f-b297-2aeafc0bd7be None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:07.656981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 92/185] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:07 2022] GET /identity/v3/role_assignments?user.id=e79a002b00ad4113b7085b364cc3f24a&scope.project.id=eadc8205943c46cfaec67ba17ede1850&role.id=717e33c007ba49a5af257abafa205f0f => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:07.712162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651ff330-e6bd-4bbe-9dc8-2b6467e2101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:07.713197 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ff330-e6bd-4bbe-9dc8-2b6467e2101e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:07.713672 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ff330-e6bd-4bbe-9dc8-2b6467e2101e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:07.714155 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651ff330-e6bd-4bbe-9dc8-2b6467e2101e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:07.715095 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ff330-e6bd-4bbe-9dc8-2b6467e2101e None admin] RBAC: Adding query filter params (role.id=7fb86065b4ef4b98873a590a9c66cfdc, scope.project.id=eadc8205943c46cfaec67ba17ede1850, user.id=e79a002b00ad4113b7085b364cc3f24a) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:07.715621 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ff330-e6bd-4bbe-9dc8-2b6467e2101e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:07.717305 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651ff330-e6bd-4bbe-9dc8-2b6467e2101e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:07.724400 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 94/186] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:07 2022] GET /identity/v3/role_assignments?user.id=e79a002b00ad4113b7085b364cc3f24a&scope.project.id=eadc8205943c46cfaec67ba17ede1850&role.id=7fb86065b4ef4b98873a590a9c66cfdc => generated 608 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:08.855493 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001786e-945a-4929-843b-1e5f024ca168 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:08.856013 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001786e-945a-4929-843b-1e5f024ca168 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:08.856013 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7001786e-945a-4929-843b-1e5f024ca168 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:08.857550 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 93/187] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:08.862934 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8513-e323-49ab-8db8-db686bbda027 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:08.863412 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8513-e323-49ab-8db8-db686bbda027 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:08.863483 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dee8513-e323-49ab-8db8-db686bbda027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:08.881689 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-4dee8513-e323-49ab-8db8-db686bbda027 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:08.882860 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-4dee8513-e323-49ab-8db8-db686bbda027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:08.925435 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:08.951845 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 95/188] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:09.006266 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d79f27-4080-438b-ba0a-9d58bec62124 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:09.006597 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d79f27-4080-438b-ba0a-9d58bec62124 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:09.006761 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d79f27-4080-438b-ba0a-9d58bec62124 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:09.008317 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 94/189] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:09.013395 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fadb1-ffcc-45e3-a673-b1e08d527cc8 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:09.013650 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fadb1-ffcc-45e3-a673-b1e08d527cc8 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:09.013943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9fadb1-ffcc-45e3-a673-b1e08d527cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:09.032281 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-9f9fadb1-ffcc-45e3-a673-b1e08d527cc8 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:09.033365 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-9f9fadb1-ffcc-45e3-a673-b1e08d527cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:09.107138 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 96/190] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:09.268060 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d79f27-4080-438b-ba0a-9d58bec62124 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:09.372541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d79f27-4080-438b-ba0a-9d58bec62124 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:09.389050 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:09.420361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703865af-0043-45d5-9ae7-b8d729efe839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:09.421043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703865af-0043-45d5-9ae7-b8d729efe839 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:09.421321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703865af-0043-45d5-9ae7-b8d729efe839 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:09.421584 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703865af-0043-45d5-9ae7-b8d729efe839 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:09.432156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703865af-0043-45d5-9ae7-b8d729efe839 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:09.434415 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fadb1-ffcc-45e3-a673-b1e08d527cc8 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-703865af-0043-45d5-9ae7-b8d729efe839 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:09.437354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:09.438195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:09.438942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 95/191] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:09.444223 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703865af-0043-45d5-9ae7-b8d729efe839 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:09.534489 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9fadb1-ffcc-45e3-a673-b1e08d527cc8 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:09.543730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:09.554777 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703865af-0043-45d5-9ae7-b8d729efe839 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:09.568612 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9644c8db-3130-4bf9-b33d-9a523c59136c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:09.569239 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644c8db-3130-4bf9-b33d-9a523c59136c None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:09.569512 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644c8db-3130-4bf9-b33d-9a523c59136c None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:09.569777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9644c8db-3130-4bf9-b33d-9a523c59136c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:09.570907 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644c8db-3130-4bf9-b33d-9a523c59136c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:09.572373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9644c8db-3130-4bf9-b33d-9a523c59136c None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:09.573958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 97/192] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:09.575092 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042d46f-1c94-41a8-b92a-cd5062f8a89e None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:09.575389 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042d46f-1c94-41a8-b92a-cd5062f8a89e None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:09.575661 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6042d46f-1c94-41a8-b92a-cd5062f8a89e None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:09.579427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 98/193] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:09.579427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042d46f-1c94-41a8-b92a-cd5062f8a89e None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:09.592524 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f65582-1367-46f9-a538-24cadba61034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:09.593100 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f65582-1367-46f9-a538-24cadba61034 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:09.593370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f65582-1367-46f9-a538-24cadba61034 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:09.593633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f65582-1367-46f9-a538-24cadba61034 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:09.594284 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f65582-1367-46f9-a538-24cadba61034 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:09.594575 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f65582-1367-46f9-a538-24cadba61034 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:09.596021 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f65582-1367-46f9-a538-24cadba61034 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:09.604209 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 96/194] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:09.609200 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e37c-5596-4172-a989-239746830f70 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:09.609200 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e37c-5596-4172-a989-239746830f70 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:09.609200 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156e37c-5596-4172-a989-239746830f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:09.623320 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-7156e37c-5596-4172-a989-239746830f70 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:09.624430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-7156e37c-5596-4172-a989-239746830f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:09.652268 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:09.679579 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6042d46f-1c94-41a8-b92a-cd5062f8a89e None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:09.689229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 97/195] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:09.690033 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156e37c-5596-4172-a989-239746830f70 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:09.714848 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f235f4-b8bc-4b33-88d8-98f58e1aff75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:09.715668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f235f4-b8bc-4b33-88d8-98f58e1aff75 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:09.715950 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f235f4-b8bc-4b33-88d8-98f58e1aff75 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:09.716500 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f235f4-b8bc-4b33-88d8-98f58e1aff75 None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:09.717423 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f235f4-b8bc-4b33-88d8-98f58e1aff75 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:09.718860 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f235f4-b8bc-4b33-88d8-98f58e1aff75 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:09.743059 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 99/196] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:31:09 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 20:31:09.794591 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156e37c-5596-4172-a989-239746830f70 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:09.832916 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad303e-2a95-4002-911e-451b01031743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:09.833558 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad303e-2a95-4002-911e-451b01031743 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:09.833826 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad303e-2a95-4002-911e-451b01031743 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:09.834199 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ad303e-2a95-4002-911e-451b01031743 None admin] PATH_INFO: `/v3/users/ac53ac29be6847b3b6d6edf2766bee20` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:09.849762 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad303e-2a95-4002-911e-451b01031743 None admin] RBAC: Authorizing `identity:get_user(user_id=ac53ac29be6847b3b6d6edf2766bee20)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:09.851331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ad303e-2a95-4002-911e-451b01031743 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:09.853272 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 98/197] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:09 2022] GET /identity/v3/users/ac53ac29be6847b3b6d6edf2766bee20 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:09.859249 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f235f4-b8bc-4b33-88d8-98f58e1aff75 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:09.892906 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:09.973209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f235f4-b8bc-4b33-88d8-98f58e1aff75 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:10.006901 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad303e-2a95-4002-911e-451b01031743 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:10.011103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df8b9-50cd-4be0-aec4-6f93ea086c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:10.011768 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df8b9-50cd-4be0-aec4-6f93ea086c49 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:10.012043 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df8b9-50cd-4be0-aec4-6f93ea086c49 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:10.012311 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244df8b9-50cd-4be0-aec4-6f93ea086c49 None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:10.013448 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244df8b9-50cd-4be0-aec4-6f93ea086c49 None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:10.014891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244df8b9-50cd-4be0-aec4-6f93ea086c49 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:10.016561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 100/198] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:09 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:10.022471 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df8b9-50cd-4be0-aec4-6f93ea086c49 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:10.038565 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:10.132203 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:10.134793 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ad303e-2a95-4002-911e-451b01031743 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:10.136038 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244df8b9-50cd-4be0-aec4-6f93ea086c49 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:10.175800 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6d7fe-7818-4d88-9590-8c65e4a92410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:10.176345 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6d7fe-7818-4d88-9590-8c65e4a92410 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:10.176612 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6d7fe-7818-4d88-9590-8c65e4a92410 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:10.176876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da6d7fe-7818-4d88-9590-8c65e4a92410 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:10.180615 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c624f3-3033-4bfe-bd45-fd3579257a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:10.181274 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c624f3-3033-4bfe-bd45-fd3579257a61 None admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:10.181550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c624f3-3033-4bfe-bd45-fd3579257a61 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:10.181818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c624f3-3033-4bfe-bd45-fd3579257a61 None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850/users/ac53ac29be6847b3b6d6edf2766bee20/roles/30f9bb25296e4cc3b8956272e117845e` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:10.183906 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c624f3-3033-4bfe-bd45-fd3579257a61 None admin] RBAC: Authorizing `identity:create_grant(project_id=eadc8205943c46cfaec67ba17ede1850, user_id=ac53ac29be6847b3b6d6edf2766bee20, role_id=30f9bb25296e4cc3b8956272e117845e)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:10.185348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c624f3-3033-4bfe-bd45-fd3579257a61 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:10.187970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da6d7fe-7818-4d88-9590-8c65e4a92410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-0da6d7fe-7818-4d88-9590-8c65e4a92410 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:10.194156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:10.195237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:10.196463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 99/199] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:10.201222 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6d7fe-7818-4d88-9590-8c65e4a92410 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:10.203574 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 101/200] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:31:10 2022] PUT /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850/users/ac53ac29be6847b3b6d6edf2766bee20/roles/30f9bb25296e4cc3b8956272e117845e => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:31:10.310318 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:10.328442 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da6d7fe-7818-4d88-9590-8c65e4a92410 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:10.368379 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603aee-1041-4bd1-aba7-255251f0976c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:10.369003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603aee-1041-4bd1-aba7-255251f0976c None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:10.369324 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603aee-1041-4bd1-aba7-255251f0976c None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:10.369584 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31603aee-1041-4bd1-aba7-255251f0976c None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:10.370313 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31603aee-1041-4bd1-aba7-255251f0976c None admin] RBAC: Adding query filter params (name=member) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:10.370614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31603aee-1041-4bd1-aba7-255251f0976c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:10.372078 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31603aee-1041-4bd1-aba7-255251f0976c None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:10.385856 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 100/201] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:10.392457 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c624f3-3033-4bfe-bd45-fd3579257a61 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:10.511207 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c624f3-3033-4bfe-bd45-fd3579257a61 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:10.548526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bd420-2612-4cb6-9b98-e41b8a740e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:10.549204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bd420-2612-4cb6-9b98-e41b8a740e3b None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:10.549481 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bd420-2612-4cb6-9b98-e41b8a740e3b None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:10.549749 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242bd420-2612-4cb6-9b98-e41b8a740e3b None admin] PATH_INFO: `/v3/users/e539b174637e4aeb9e8ced5baf3b4918` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:10.550887 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bd420-2612-4cb6-9b98-e41b8a740e3b None admin] RBAC: Authorizing `identity:get_user(user_id=e539b174637e4aeb9e8ced5baf3b4918)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:10.552343 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242bd420-2612-4cb6-9b98-e41b8a740e3b None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:10.554291 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 102/202] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:10 2022] GET /identity/v3/users/e539b174637e4aeb9e8ced5baf3b4918 => generated 297 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:10.559762 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603aee-1041-4bd1-aba7-255251f0976c None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:10.669795 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31603aee-1041-4bd1-aba7-255251f0976c None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:10.705156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c88c4-fcc3-4f63-9382-7880dd5bb8b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:10.705821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c88c4-fcc3-4f63-9382-7880dd5bb8b1 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:10.706151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c88c4-fcc3-4f63-9382-7880dd5bb8b1 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:10.706420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34c88c4-fcc3-4f63-9382-7880dd5bb8b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:10.725698 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:10.782200 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c88c4-fcc3-4f63-9382-7880dd5bb8b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:10.783904 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34c88c4-fcc3-4f63-9382-7880dd5bb8b1 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:10.883516 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 101/203] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:10.888894 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bd420-2612-4cb6-9b98-e41b8a740e3b None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:10.918796 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:10.990541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242bd420-2612-4cb6-9b98-e41b8a740e3b None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:11.023715 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eb7075-3e2b-4659-bc0d-a01922f53752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:11.024347 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb7075-3e2b-4659-bc0d-a01922f53752 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:11.024603 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb7075-3e2b-4659-bc0d-a01922f53752 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:11.024866 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eb7075-3e2b-4659-bc0d-a01922f53752 None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:11.025985 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb7075-3e2b-4659-bc0d-a01922f53752 None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:11.027464 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eb7075-3e2b-4659-bc0d-a01922f53752 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:11.033029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 103/204] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:10 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:11.035623 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c88c4-fcc3-4f63-9382-7880dd5bb8b1 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:11.084627 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:11.140063 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34c88c4-fcc3-4f63-9382-7880dd5bb8b1 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:11.181486 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649f1302-be8a-4be8-a5f0-bcbd8c52c3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:11.182100 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f1302-be8a-4be8-a5f0-bcbd8c52c3c0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:11.182371 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f1302-be8a-4be8-a5f0-bcbd8c52c3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:11.182636 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649f1302-be8a-4be8-a5f0-bcbd8c52c3c0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:11.183383 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f1302-be8a-4be8-a5f0-bcbd8c52c3c0 None admin] RBAC: Adding query filter params (role.id=72c390b29d3240dd8c46b0fd1b18441e, scope.project.id=eadc8205943c46cfaec67ba17ede1850, user.id=e539b174637e4aeb9e8ced5baf3b4918) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:11.183684 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f1302-be8a-4be8-a5f0-bcbd8c52c3c0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:11.185194 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649f1302-be8a-4be8-a5f0-bcbd8c52c3c0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:11.191715 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 102/205] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:11 2022] GET /identity/v3/role_assignments?user.id=e539b174637e4aeb9e8ced5baf3b4918&scope.project.id=eadc8205943c46cfaec67ba17ede1850&role.id=72c390b29d3240dd8c46b0fd1b18441e => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:12.404024 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1e9ec-e0a4-41b7-9df0-a0c0c7dd8432 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:12.404793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1e9ec-e0a4-41b7-9df0-a0c0c7dd8432 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:12.404793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb1e9ec-e0a4-41b7-9df0-a0c0c7dd8432 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:12.405897 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 104/206] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:12.411645 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ea175-820e-4afa-9898-409f00631776 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:12.412150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ea175-820e-4afa-9898-409f00631776 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:12.412550 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7ea175-820e-4afa-9898-409f00631776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:12.414566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccc84-bf55-4f9c-b219-361024bfade2 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:12.414846 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccc84-bf55-4f9c-b219-361024bfade2 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:12.415110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ccc84-bf55-4f9c-b219-361024bfade2 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:12.416479 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 105/207] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:12.423420 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0887a-15c9-4618-8a85-226925cf5148 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:12.423755 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0887a-15c9-4618-8a85-226925cf5148 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:12.424107 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a0887a-15c9-4618-8a85-226925cf5148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:12.435364 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-2e7ea175-820e-4afa-9898-409f00631776 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:12.436566 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-2e7ea175-820e-4afa-9898-409f00631776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:12.443249 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-08a0887a-15c9-4618-8a85-226925cf5148 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:12.444474 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-08a0887a-15c9-4618-8a85-226925cf5148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:12.509680 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 103/208] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:12.518616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 106/209] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:12.664298 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d384b7-3a70-4242-8827-2a130d29ad81 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:12.664656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d384b7-3a70-4242-8827-2a130d29ad81 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:12.665004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d384b7-3a70-4242-8827-2a130d29ad81 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:12.667293 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 104/210] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:12.671980 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dede971-cf48-4b87-ad22-bca9b2540644 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:12.672326 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dede971-cf48-4b87-ad22-bca9b2540644 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:12.672662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dede971-cf48-4b87-ad22-bca9b2540644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:12.691211 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-1dede971-cf48-4b87-ad22-bca9b2540644 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:12.692470 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-1dede971-cf48-4b87-ad22-bca9b2540644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:12.712371 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:12.759367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 107/211] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:12.824146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d384b7-3a70-4242-8827-2a130d29ad81 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:12.834768 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dede971-cf48-4b87-ad22-bca9b2540644 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:12.873069 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:12.930786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d384b7-3a70-4242-8827-2a130d29ad81 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:12.944777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dede971-cf48-4b87-ad22-bca9b2540644 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:12.965464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea894f8-489c-4477-b9c2-5d5c4e10fcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:12.966062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea894f8-489c-4477-b9c2-5d5c4e10fcb4 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:12.966329 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea894f8-489c-4477-b9c2-5d5c4e10fcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:12.966588 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea894f8-489c-4477-b9c2-5d5c4e10fcb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:12.976749 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea894f8-489c-4477-b9c2-5d5c4e10fcb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:12.980557 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b0bdd-7b41-4b6f-8d62-bfb9d5f42967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:12.981184 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b0bdd-7b41-4b6f-8d62-bfb9d5f42967 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:12.981513 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b0bdd-7b41-4b6f-8d62-bfb9d5f42967 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:12.981778 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90b0bdd-7b41-4b6f-8d62-bfb9d5f42967 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-1ea894f8-489c-4477-b9c2-5d5c4e10fcb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:12.982137 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:12.982960 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:12.983732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 105/212] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:12.985487 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b0bdd-7b41-4b6f-8d62-bfb9d5f42967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:12.986977 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90b0bdd-7b41-4b6f-8d62-bfb9d5f42967 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:12.991312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 108/213] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:12.991449 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea894f8-489c-4477-b9c2-5d5c4e10fcb4 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:12.994009 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b0bdd-7b41-4b6f-8d62-bfb9d5f42967 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:13.020218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:13.093507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea894f8-489c-4477-b9c2-5d5c4e10fcb4 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:13.093700 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90b0bdd-7b41-4b6f-8d62-bfb9d5f42967 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:13.094998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:13.125618 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc553f-6fa6-4fae-861f-9636fe46e5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:13.126218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc553f-6fa6-4fae-861f-9636fe46e5c2 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:13.126497 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc553f-6fa6-4fae-861f-9636fe46e5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:13.126765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bc553f-6fa6-4fae-861f-9636fe46e5c2 None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:13.127438 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc553f-6fa6-4fae-861f-9636fe46e5c2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:13.128566 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cb0e8-c392-4ec4-8226-4da39bf5bae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:13.128876 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bc553f-6fa6-4fae-861f-9636fe46e5c2 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:13.129163 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb0e8-c392-4ec4-8226-4da39bf5bae7 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:13.129440 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb0e8-c392-4ec4-8226-4da39bf5bae7 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:13.129707 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831cb0e8-c392-4ec4-8226-4da39bf5bae7 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:13.130361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cb0e8-c392-4ec4-8226-4da39bf5bae7 None admin] RBAC: Adding query filter params (name=member) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:13.130656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cb0e8-c392-4ec4-8226-4da39bf5bae7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:13.132116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831cb0e8-c392-4ec4-8226-4da39bf5bae7 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:13.140001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 106/214] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:13.144146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cb0e8-c392-4ec4-8226-4da39bf5bae7 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:13.162114 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 109/215] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:31:12 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 20:31:13.162114 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc553f-6fa6-4fae-861f-9636fe46e5c2 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:13.237943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:13.262192 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bc553f-6fa6-4fae-861f-9636fe46e5c2 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:13.276815 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831cb0e8-c392-4ec4-8226-4da39bf5bae7 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:13.298988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341936d-8ba3-4730-bd78-5774c1bb3a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:13.299752 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341936d-8ba3-4730-bd78-5774c1bb3a0d None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:13.300090 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341936d-8ba3-4730-bd78-5774c1bb3a0d None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:13.300420 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341936d-8ba3-4730-bd78-5774c1bb3a0d None admin] PATH_INFO: `/v3/users/541d009a1c0042ac8dc40a8064807ee5` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:13.312913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1c2b-0f1d-4c82-8cb9-71c52e10ccf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:13.313678 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1c2b-0f1d-4c82-8cb9-71c52e10ccf7 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:13.313956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1c2b-0f1d-4c82-8cb9-71c52e10ccf7 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:13.314222 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b55b1c2b-0f1d-4c82-8cb9-71c52e10ccf7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:13.316354 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341936d-8ba3-4730-bd78-5774c1bb3a0d None admin] RBAC: Authorizing `identity:get_user(user_id=541d009a1c0042ac8dc40a8064807ee5)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:13.318007 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0341936d-8ba3-4730-bd78-5774c1bb3a0d None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:13.320237 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 110/216] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:13 2022] GET /identity/v3/users/541d009a1c0042ac8dc40a8064807ee5 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:13.326013 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341936d-8ba3-4730-bd78-5774c1bb3a0d None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:13.330282 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b55b1c2b-0f1d-4c82-8cb9-71c52e10ccf7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-b55b1c2b-0f1d-4c82-8cb9-71c52e10ccf7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:13.336017 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:13.337103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:13.340167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 107/217] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:13.343152 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1c2b-0f1d-4c82-8cb9-71c52e10ccf7 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:13.371597 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:13.453987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341936d-8ba3-4730-bd78-5774c1bb3a0d None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:13.464965 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b55b1c2b-0f1d-4c82-8cb9-71c52e10ccf7 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:13.496505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b9ba0-3a1e-4752-ae10-f33f3a5f741a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:13.497042 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b9ba0-3a1e-4752-ae10-f33f3a5f741a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:13.497321 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b9ba0-3a1e-4752-ae10-f33f3a5f741a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:13.497617 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844b9ba0-3a1e-4752-ae10-f33f3a5f741a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:13.498300 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b9ba0-3a1e-4752-ae10-f33f3a5f741a None admin] RBAC: Adding query filter params (role.id=72c390b29d3240dd8c46b0fd1b18441e, user.id=541d009a1c0042ac8dc40a8064807ee5, scope.system=all) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:13.498596 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b9ba0-3a1e-4752-ae10-f33f3a5f741a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:13.500358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844b9ba0-3a1e-4752-ae10-f33f3a5f741a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:13.504759 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081477b-19a8-4094-84c0-2a9048d9f302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:13.505379 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081477b-19a8-4094-84c0-2a9048d9f302 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:13.505655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081477b-19a8-4094-84c0-2a9048d9f302 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:13.505950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3081477b-19a8-4094-84c0-2a9048d9f302 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:13.506378 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 111/218] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Oct 22 20:31:13 2022] GET /identity/v3/role_assignments?user.id=541d009a1c0042ac8dc40a8064807ee5&scope.system=all&role.id=72c390b29d3240dd8c46b0fd1b18441e => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:13.506698 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081477b-19a8-4094-84c0-2a9048d9f302 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:13.506998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081477b-19a8-4094-84c0-2a9048d9f302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:13.508533 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3081477b-19a8-4094-84c0-2a9048d9f302 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:13.520881 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 108/219] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:13.526984 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b9ba0-3a1e-4752-ae10-f33f3a5f741a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:13.529963 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:13.637836 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844b9ba0-3a1e-4752-ae10-f33f3a5f741a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:13.675853 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772492d-50a8-47a1-8a85-b16fa41c8cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:13.676507 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772492d-50a8-47a1-8a85-b16fa41c8cfa None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:13.676783 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772492d-50a8-47a1-8a85-b16fa41c8cfa None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:13.677051 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7772492d-50a8-47a1-8a85-b16fa41c8cfa None admin] PATH_INFO: `/v3/users/ac53ac29be6847b3b6d6edf2766bee20` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:13.678376 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772492d-50a8-47a1-8a85-b16fa41c8cfa None admin] RBAC: Authorizing `identity:get_user(user_id=ac53ac29be6847b3b6d6edf2766bee20)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:13.679883 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7772492d-50a8-47a1-8a85-b16fa41c8cfa None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:13.681676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 112/220] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:13 2022] GET /identity/v3/users/ac53ac29be6847b3b6d6edf2766bee20 => generated 297 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:13.687471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081477b-19a8-4094-84c0-2a9048d9f302 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:13.779767 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:13.795634 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3081477b-19a8-4094-84c0-2a9048d9f302 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:13.830134 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b28b7-6a05-4a71-9515-62dd3ba0027d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:13.830736 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b28b7-6a05-4a71-9515-62dd3ba0027d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:13.831018 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b28b7-6a05-4a71-9515-62dd3ba0027d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:13.831299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6b28b7-6a05-4a71-9515-62dd3ba0027d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:13.901070 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b28b7-6a05-4a71-9515-62dd3ba0027d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:13.902882 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6b28b7-6a05-4a71-9515-62dd3ba0027d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:13.994798 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:14.011617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 109/221] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:14.020638 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772492d-50a8-47a1-8a85-b16fa41c8cfa None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:14.093035 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:14.128256 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7772492d-50a8-47a1-8a85-b16fa41c8cfa None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:14.162327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88747e73-1050-46ce-9dea-8c16dad0aa47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:14.162966 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747e73-1050-46ce-9dea-8c16dad0aa47 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:14.163242 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747e73-1050-46ce-9dea-8c16dad0aa47 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:14.163582 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88747e73-1050-46ce-9dea-8c16dad0aa47 None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:14.164699 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88747e73-1050-46ce-9dea-8c16dad0aa47 None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:14.166139 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88747e73-1050-46ce-9dea-8c16dad0aa47 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:14.167795 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 113/222] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:14 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:14.173723 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b28b7-6a05-4a71-9515-62dd3ba0027d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:14.273698 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6b28b7-6a05-4a71-9515-62dd3ba0027d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:14.308389 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee90c324-98b0-4dfe-84fa-f06cff331468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:14.308993 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c324-98b0-4dfe-84fa-f06cff331468 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:14.309356 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c324-98b0-4dfe-84fa-f06cff331468 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:14.309626 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee90c324-98b0-4dfe-84fa-f06cff331468 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:14.310341 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90c324-98b0-4dfe-84fa-f06cff331468 None admin] RBAC: Adding query filter params (role.id=30f9bb25296e4cc3b8956272e117845e, scope.project.id=eadc8205943c46cfaec67ba17ede1850, user.id=ac53ac29be6847b3b6d6edf2766bee20) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:14.310638 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90c324-98b0-4dfe-84fa-f06cff331468 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:14.312095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee90c324-98b0-4dfe-84fa-f06cff331468 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:14.317970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 110/223] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:14 2022] GET /identity/v3/role_assignments?user.id=ac53ac29be6847b3b6d6edf2766bee20&scope.project.id=eadc8205943c46cfaec67ba17ede1850&role.id=30f9bb25296e4cc3b8956272e117845e => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:15.700633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c6b1c-af09-44d0-b69d-bae05a1efdad None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:15.701648 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c6b1c-af09-44d0-b69d-bae05a1efdad None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:15.702127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9c6b1c-af09-44d0-b69d-bae05a1efdad None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:15.703712 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 114/224] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:15.709378 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35055d-7e5f-4ebe-9c6f-26ebed1652f3 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:15.709805 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35055d-7e5f-4ebe-9c6f-26ebed1652f3 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:15.709876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a35055d-7e5f-4ebe-9c6f-26ebed1652f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:15.728363 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-9a35055d-7e5f-4ebe-9c6f-26ebed1652f3 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:15.729538 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-9a35055d-7e5f-4ebe-9c6f-26ebed1652f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:15.777292 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:15.796038 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368e43f-c0c7-4a3b-9535-52f8f6b4c7ee None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:15.796313 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368e43f-c0c7-4a3b-9535-52f8f6b4c7ee None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:15.796583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2368e43f-c0c7-4a3b-9535-52f8f6b4c7ee None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:15.798045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 115/225] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:31:15.799310 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 111/226] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:15.803111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343809f-c602-47bb-80da-3839505386e9 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:15.803425 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343809f-c602-47bb-80da-3839505386e9 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:15.803692 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b343809f-c602-47bb-80da-3839505386e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:15.821605 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-b343809f-c602-47bb-80da-3839505386e9 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:15.822780 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-b343809f-c602-47bb-80da-3839505386e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:15.889202 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 116/227] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:15.976134 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a154a-665f-41bd-a5c2-8911727ff893 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:15.976328 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a154a-665f-41bd-a5c2-8911727ff893 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:15.976594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a154a-665f-41bd-a5c2-8911727ff893 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:15.978106 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 112/228] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:15.984280 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116beb4-269b-4a59-ae32-f38a53ef4065 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:15.984561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116beb4-269b-4a59-ae32-f38a53ef4065 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:15.984830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9116beb4-269b-4a59-ae32-f38a53ef4065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.003189 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-9116beb4-269b-4a59-ae32-f38a53ef4065 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:16.004390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-9116beb4-269b-4a59-ae32-f38a53ef4065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:16.066652 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:16.073561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 117/229] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:16.113383 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a154a-665f-41bd-a5c2-8911727ff893 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:16.202610 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116beb4-269b-4a59-ae32-f38a53ef4065 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:16.216184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a154a-665f-41bd-a5c2-8911727ff893 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:16.254537 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3371bd-9600-41be-b128-93e3a2cd51cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:16.255176 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3371bd-9600-41be-b128-93e3a2cd51cf None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:16.255495 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3371bd-9600-41be-b128-93e3a2cd51cf None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:16.255817 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3371bd-9600-41be-b128-93e3a2cd51cf None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.266432 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3371bd-9600-41be-b128-93e3a2cd51cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-6b3371bd-9600-41be-b128-93e3a2cd51cf None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:16.271004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:16.272027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:16.273059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 113/230] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:16.277817 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3371bd-9600-41be-b128-93e3a2cd51cf None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:16.311551 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9116beb4-269b-4a59-ae32-f38a53ef4065 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:16.323912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:16.347798 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab90e1e-3e7c-4f49-9c80-bdc2ac953f0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:16.348421 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab90e1e-3e7c-4f49-9c80-bdc2ac953f0c None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:16.348690 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab90e1e-3e7c-4f49-9c80-bdc2ac953f0c None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:16.348952 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab90e1e-3e7c-4f49-9c80-bdc2ac953f0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.350099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab90e1e-3e7c-4f49-9c80-bdc2ac953f0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:16.351556 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bab90e1e-3e7c-4f49-9c80-bdc2ac953f0c None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:16.358084 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 118/231] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:16.358860 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab90e1e-3e7c-4f49-9c80-bdc2ac953f0c None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:16.384979 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3371bd-9600-41be-b128-93e3a2cd51cf None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:16.421604 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14883a-5c13-4682-a522-dc1e6b0a28e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:16.422194 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14883a-5c13-4682-a522-dc1e6b0a28e3 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:16.422465 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14883a-5c13-4682-a522-dc1e6b0a28e3 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:16.422726 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14883a-5c13-4682-a522-dc1e6b0a28e3 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.423412 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14883a-5c13-4682-a522-dc1e6b0a28e3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:16.423701 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14883a-5c13-4682-a522-dc1e6b0a28e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:16.425080 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14883a-5c13-4682-a522-dc1e6b0a28e3 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:16.426568 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:16.433358 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 114/232] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:16.436013 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14883a-5c13-4682-a522-dc1e6b0a28e3 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:16.467238 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab90e1e-3e7c-4f49-9c80-bdc2ac953f0c None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:16.501429 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e26453-0e75-4b76-8b11-31bffeb138d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:16.502018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e26453-0e75-4b76-8b11-31bffeb138d2 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:16.502296 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e26453-0e75-4b76-8b11-31bffeb138d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:16.502562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e26453-0e75-4b76-8b11-31bffeb138d2 None admin] PATH_INFO: `/v3/groups` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.503174 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e26453-0e75-4b76-8b11-31bffeb138d2 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:16.504691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e26453-0e75-4b76-8b11-31bffeb138d2 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:16.520032 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 119/233] 10.222.0.39 () {60 vars in 1134 bytes} [Sat Oct 22 20:31:16 2022] POST /identity/v3/groups => generated 229 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:31:16.520815 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e26453-0e75-4b76-8b11-31bffeb138d2 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:16.557556 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14883a-5c13-4682-a522-dc1e6b0a28e3 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:16.559502 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:16.596575 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98572ce8-36fc-452d-a115-a00261c50943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:16.597224 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98572ce8-36fc-452d-a115-a00261c50943 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:16.597502 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98572ce8-36fc-452d-a115-a00261c50943 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:16.597778 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98572ce8-36fc-452d-a115-a00261c50943 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.609573 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98572ce8-36fc-452d-a115-a00261c50943 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-98572ce8-36fc-452d-a115-a00261c50943 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:16.614576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:16.615862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:16.616633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 115/234] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:16.621825 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98572ce8-36fc-452d-a115-a00261c50943 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:16.637140 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e26453-0e75-4b76-8b11-31bffeb138d2 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:16.668878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:16.680775 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65538d3f-b3e5-4020-bdef-67dd6f150d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:16.681425 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65538d3f-b3e5-4020-bdef-67dd6f150d8a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:16.681700 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65538d3f-b3e5-4020-bdef-67dd6f150d8a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:16.681991 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65538d3f-b3e5-4020-bdef-67dd6f150d8a None admin] PATH_INFO: `/v3/users/36fd94517b3b450881832e8edc7164b5` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.697106 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65538d3f-b3e5-4020-bdef-67dd6f150d8a None admin] RBAC: Authorizing `identity:get_user(user_id=36fd94517b3b450881832e8edc7164b5)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:16.698594 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65538d3f-b3e5-4020-bdef-67dd6f150d8a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:16.700350 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 120/235] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:16 2022] GET /identity/v3/users/36fd94517b3b450881832e8edc7164b5 => generated 293 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:16.706393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65538d3f-b3e5-4020-bdef-67dd6f150d8a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:16.743941 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98572ce8-36fc-452d-a115-a00261c50943 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:16.779967 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6395c-f0cd-4818-a7e2-b3b0849896d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:16.780489 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6395c-f0cd-4818-a7e2-b3b0849896d5 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:16.780769 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6395c-f0cd-4818-a7e2-b3b0849896d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:16.781036 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6395c-f0cd-4818-a7e2-b3b0849896d5 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.781695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6395c-f0cd-4818-a7e2-b3b0849896d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:16.782002 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6395c-f0cd-4818-a7e2-b3b0849896d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:16.783483 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6395c-f0cd-4818-a7e2-b3b0849896d5 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:16.792180 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 116/236] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:16.797423 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6395c-f0cd-4818-a7e2-b3b0849896d5 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:16.822875 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:16.825999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65538d3f-b3e5-4020-bdef-67dd6f150d8a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:16.860455 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead19047-1773-4b56-8ddd-05db52a49f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:16.861057 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead19047-1773-4b56-8ddd-05db52a49f3a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:16.861318 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead19047-1773-4b56-8ddd-05db52a49f3a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:16.861579 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead19047-1773-4b56-8ddd-05db52a49f3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.862293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead19047-1773-4b56-8ddd-05db52a49f3a None admin] RBAC: Adding query filter params (role.id=30f9bb25296e4cc3b8956272e117845e, user.id=36fd94517b3b450881832e8edc7164b5, scope.system=all) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:16.862587 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead19047-1773-4b56-8ddd-05db52a49f3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:16.864098 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead19047-1773-4b56-8ddd-05db52a49f3a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:16.869183 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 121/237] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Oct 22 20:31:16 2022] GET /identity/v3/role_assignments?user.id=36fd94517b3b450881832e8edc7164b5&scope.system=all&role.id=30f9bb25296e4cc3b8956272e117845e => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:16.908563 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6395c-f0cd-4818-a7e2-b3b0849896d5 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:16.947242 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3572730b-310d-4e54-a1be-7bc14565806e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:16.947932 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572730b-310d-4e54-a1be-7bc14565806e None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:16.948195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572730b-310d-4e54-a1be-7bc14565806e None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:16.948466 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3572730b-310d-4e54-a1be-7bc14565806e None admin] PATH_INFO: `/v3/users/541d009a1c0042ac8dc40a8064807ee5` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:16.949705 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572730b-310d-4e54-a1be-7bc14565806e None admin] RBAC: Authorizing `identity:get_user(user_id=541d009a1c0042ac8dc40a8064807ee5)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:16.951172 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3572730b-310d-4e54-a1be-7bc14565806e None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:16.953046 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 117/238] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:16 2022] GET /identity/v3/users/541d009a1c0042ac8dc40a8064807ee5 => generated 293 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:16.958695 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead19047-1773-4b56-8ddd-05db52a49f3a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:17.015120 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:17.079650 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead19047-1773-4b56-8ddd-05db52a49f3a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:17.114461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6fa2a-926d-4e4d-abc4-00e97782580d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:17.115138 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fa2a-926d-4e4d-abc4-00e97782580d None admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:17.115451 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fa2a-926d-4e4d-abc4-00e97782580d None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:17.115722 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6fa2a-926d-4e4d-abc4-00e97782580d None admin] PATH_INFO: `/v3/system/users/541d009a1c0042ac8dc40a8064807ee5/roles/72c390b29d3240dd8c46b0fd1b18441e` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:17.117144 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6fa2a-926d-4e4d-abc4-00e97782580d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=541d009a1c0042ac8dc40a8064807ee5, role_id=72c390b29d3240dd8c46b0fd1b18441e)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:17.118528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6fa2a-926d-4e4d-abc4-00e97782580d None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:17.129919 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 122/239] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Oct 22 20:31:16 2022] PUT /identity/v3/system/users/541d009a1c0042ac8dc40a8064807ee5/roles/72c390b29d3240dd8c46b0fd1b18441e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:31:18.928507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22879-fbd6-4b6f-9adb-17d077d217fe None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:18.929111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22879-fbd6-4b6f-9adb-17d077d217fe None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:18.929111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22879-fbd6-4b6f-9adb-17d077d217fe None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:18.930528 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 118/240] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:18.935918 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dad13-9adf-4d0d-ad87-1d8218cadbc1 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:18.936330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dad13-9adf-4d0d-ad87-1d8218cadbc1 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:18.936402 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4dad13-9adf-4d0d-ad87-1d8218cadbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:18.954983 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-8f4dad13-9adf-4d0d-ad87-1d8218cadbc1 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:18.956170 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-8f4dad13-9adf-4d0d-ad87-1d8218cadbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:19.026402 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 123/241] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:19.243522 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f63a-700d-413d-a395-b88f16c0b7bb None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:19.243906 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f63a-700d-413d-a395-b88f16c0b7bb None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:19.244105 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa9f63a-700d-413d-a395-b88f16c0b7bb None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:19.245458 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 119/242] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:19.250908 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18924757-fec0-4a3c-8e40-f6a52df0cb4a None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:19.251194 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18924757-fec0-4a3c-8e40-f6a52df0cb4a None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:19.251504 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18924757-fec0-4a3c-8e40-f6a52df0cb4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:19.270340 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-18924757-fec0-4a3c-8e40-f6a52df0cb4a None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:19.271586 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-18924757-fec0-4a3c-8e40-f6a52df0cb4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:19.309191 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:19.341089 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 124/243] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:19.342757 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f63a-700d-413d-a395-b88f16c0b7bb None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:19.455555 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:19.465922 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa9f63a-700d-413d-a395-b88f16c0b7bb None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:19.506818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5948d-a260-4fc1-8778-dd639c1f8254 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:19.506818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5948d-a260-4fc1-8778-dd639c1f8254 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:19.506818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5948d-a260-4fc1-8778-dd639c1f8254 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:19.508091 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 125/244] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:31:19.513177 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fdf05-15ef-4f91-9719-5026bb6c9919 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:19.513467 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fdf05-15ef-4f91-9719-5026bb6c9919 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:19.513740 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fdf05-15ef-4f91-9719-5026bb6c9919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:19.515572 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdab14-296d-4e91-893a-c86ce9c740e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:19.518345 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdab14-296d-4e91-893a-c86ce9c740e0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:19.518617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdab14-296d-4e91-893a-c86ce9c740e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:19.518875 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefdab14-296d-4e91-893a-c86ce9c740e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:19.520005 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdab14-296d-4e91-893a-c86ce9c740e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:19.521607 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefdab14-296d-4e91-893a-c86ce9c740e0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:19.523462 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 120/245] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:19.529126 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdab14-296d-4e91-893a-c86ce9c740e0 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:19.542966 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-c58fdf05-15ef-4f91-9719-5026bb6c9919 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:19.544717 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-c58fdf05-15ef-4f91-9719-5026bb6c9919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:19.636376 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 126/246] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:19.636567 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefdab14-296d-4e91-893a-c86ce9c740e0 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:19.664236 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fdf05-15ef-4f91-9719-5026bb6c9919 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:19.670797 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27e88a-9359-4115-9dfe-f77277ff8daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:19.671482 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27e88a-9359-4115-9dfe-f77277ff8daa None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:19.671768 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27e88a-9359-4115-9dfe-f77277ff8daa None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:19.672038 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b27e88a-9359-4115-9dfe-f77277ff8daa None admin] PATH_INFO: `/v3/groups` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:19.672821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27e88a-9359-4115-9dfe-f77277ff8daa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:19.674395 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b27e88a-9359-4115-9dfe-f77277ff8daa None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:19.703291 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 121/247] 10.222.0.39 () {60 vars in 1134 bytes} [Sat Oct 22 20:31:19 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 20:31:19.783028 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fdf05-15ef-4f91-9719-5026bb6c9919 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:19.784717 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:19.820498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbbd12-a3d3-44f3-9950-2beabd554009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:19.821145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbbd12-a3d3-44f3-9950-2beabd554009 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:19.821421 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbbd12-a3d3-44f3-9950-2beabd554009 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:19.821690 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cbbd12-a3d3-44f3-9950-2beabd554009 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:19.832839 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cbbd12-a3d3-44f3-9950-2beabd554009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-f8cbbd12-a3d3-44f3-9950-2beabd554009 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:19.837766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:19.838683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:19.839525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:19.843669 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 127/248] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:31:19.845169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27e88a-9359-4115-9dfe-f77277ff8daa None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:19.872744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:19.949222 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbbd12-a3d3-44f3-9950-2beabd554009 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:19.962395 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b27e88a-9359-4115-9dfe-f77277ff8daa None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:19.999902 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f67f53-f46a-481a-936a-3d3e89de18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:20.000514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f67f53-f46a-481a-936a-3d3e89de18dc None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:20.000790 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f67f53-f46a-481a-936a-3d3e89de18dc None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:20.001058 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f67f53-f46a-481a-936a-3d3e89de18dc None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:20.004553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f67f53-f46a-481a-936a-3d3e89de18dc None admin] RBAC: Adding query filter params (name=reader) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:20.004553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f67f53-f46a-481a-936a-3d3e89de18dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:20.004553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f67f53-f46a-481a-936a-3d3e89de18dc None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:20.013437 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 122/249] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:20.019855 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f67f53-f46a-481a-936a-3d3e89de18dc None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:20.077336 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cbbd12-a3d3-44f3-9950-2beabd554009 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:20.112680 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:20.120715 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff45e6-e146-4025-96dd-6adaa456272f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:20.121350 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff45e6-e146-4025-96dd-6adaa456272f None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:20.122078 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff45e6-e146-4025-96dd-6adaa456272f None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:20.122355 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ff45e6-e146-4025-96dd-6adaa456272f None admin] PATH_INFO: `/v3/roles/member` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:20.134789 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ff45e6-e146-4025-96dd-6adaa456272f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:20.135724 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f67f53-f46a-481a-936a-3d3e89de18dc None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-64ff45e6-e146-4025-96dd-6adaa456272f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:20.139811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:20.140691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:20.141463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:20.142050 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 128/250] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:31:20.150075 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff45e6-e146-4025-96dd-6adaa456272f None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:20.177285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:20.182211 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328d208-3bd4-4fd9-a6b2-fb789b8faeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:20.182839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328d208-3bd4-4fd9-a6b2-fb789b8faeb0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:20.183110 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328d208-3bd4-4fd9-a6b2-fb789b8faeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:20.183412 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4328d208-3bd4-4fd9-a6b2-fb789b8faeb0 None admin] PATH_INFO: `/v3/users/36fd94517b3b450881832e8edc7164b5` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:20.184544 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328d208-3bd4-4fd9-a6b2-fb789b8faeb0 None admin] RBAC: Authorizing `identity:get_user(user_id=36fd94517b3b450881832e8edc7164b5)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:20.186025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4328d208-3bd4-4fd9-a6b2-fb789b8faeb0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:20.187953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 123/251] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:20 2022] GET /identity/v3/users/36fd94517b3b450881832e8edc7164b5 => generated 293 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:20.195175 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328d208-3bd4-4fd9-a6b2-fb789b8faeb0 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:20.277903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ff45e6-e146-4025-96dd-6adaa456272f None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:20.316989 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790b23c-fd0b-4dc6-9699-bbfa81244d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:20.318162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790b23c-fd0b-4dc6-9699-bbfa81244d4a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:20.319115 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790b23c-fd0b-4dc6-9699-bbfa81244d4a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:20.319702 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790b23c-fd0b-4dc6-9699-bbfa81244d4a None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:20.321558 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790b23c-fd0b-4dc6-9699-bbfa81244d4a None admin] RBAC: Adding query filter params (name=member) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:20.322116 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790b23c-fd0b-4dc6-9699-bbfa81244d4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:20.323654 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790b23c-fd0b-4dc6-9699-bbfa81244d4a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:20.324509 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4328d208-3bd4-4fd9-a6b2-fb789b8faeb0 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:20.334808 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 129/252] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:20.339974 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790b23c-fd0b-4dc6-9699-bbfa81244d4a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:20.366573 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949ed06-e606-43a0-a1e0-46d012f10aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:20.367916 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949ed06-e606-43a0-a1e0-46d012f10aa7 None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:20.368350 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949ed06-e606-43a0-a1e0-46d012f10aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:20.368788 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e949ed06-e606-43a0-a1e0-46d012f10aa7 None admin] PATH_INFO: `/v3/system/users/36fd94517b3b450881832e8edc7164b5/roles/30f9bb25296e4cc3b8956272e117845e` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:20.370791 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949ed06-e606-43a0-a1e0-46d012f10aa7 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=36fd94517b3b450881832e8edc7164b5, role_id=30f9bb25296e4cc3b8956272e117845e)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:20.373191 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e949ed06-e606-43a0-a1e0-46d012f10aa7 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:20.388380 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 124/253] 10.222.0.39 () {58 vars in 1334 bytes} [Sat Oct 22 20:31:20 2022] PUT /identity/v3/system/users/36fd94517b3b450881832e8edc7164b5/roles/30f9bb25296e4cc3b8956272e117845e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:31:20.452941 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:20.476223 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790b23c-fd0b-4dc6-9699-bbfa81244d4a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:20.516252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd03a5c6-491d-4573-8ea3-024d76097980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:20.517207 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03a5c6-491d-4573-8ea3-024d76097980 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:20.517645 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03a5c6-491d-4573-8ea3-024d76097980 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:20.518055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd03a5c6-491d-4573-8ea3-024d76097980 None admin] PATH_INFO: `/v3/users/541d009a1c0042ac8dc40a8064807ee5` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:20.519543 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03a5c6-491d-4573-8ea3-024d76097980 None admin] RBAC: Authorizing `identity:get_user(user_id=541d009a1c0042ac8dc40a8064807ee5)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:20.521350 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd03a5c6-491d-4573-8ea3-024d76097980 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:20.523542 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 130/254] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:20 2022] GET /identity/v3/users/541d009a1c0042ac8dc40a8064807ee5 => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:20.530070 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949ed06-e606-43a0-a1e0-46d012f10aa7 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:20.553536 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:20.655212 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e949ed06-e606-43a0-a1e0-46d012f10aa7 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:20.692181 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff5699b-3760-40ad-aaec-32102edc43e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:20.692853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5699b-3760-40ad-aaec-32102edc43e1 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:20.693194 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5699b-3760-40ad-aaec-32102edc43e1 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:20.693464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff5699b-3760-40ad-aaec-32102edc43e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:20.694265 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5699b-3760-40ad-aaec-32102edc43e1 None admin] RBAC: Adding query filter params (role.id=72c390b29d3240dd8c46b0fd1b18441e, user.id=541d009a1c0042ac8dc40a8064807ee5, scope.system=all) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:20.694569 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5699b-3760-40ad-aaec-32102edc43e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:20.696046 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff5699b-3760-40ad-aaec-32102edc43e1 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:20.708309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 125/255] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Oct 22 20:31:20 2022] GET /identity/v3/role_assignments?user.id=541d009a1c0042ac8dc40a8064807ee5&scope.system=all&role.id=72c390b29d3240dd8c46b0fd1b18441e => generated 510 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:22.832421 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927326d-aa59-4fa8-8119-c7f1ff03ba3f None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:22.832946 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927326d-aa59-4fa8-8119-c7f1ff03ba3f None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:22.833164 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927326d-aa59-4fa8-8119-c7f1ff03ba3f None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:22.834871 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 131/256] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:22.840392 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748f83d-c369-4cb9-8ff1-3a35327a930f None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:22.840910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748f83d-c369-4cb9-8ff1-3a35327a930f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:22.841133 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b748f83d-c369-4cb9-8ff1-3a35327a930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:22.866026 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-b748f83d-c369-4cb9-8ff1-3a35327a930f None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:22.867216 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-b748f83d-c369-4cb9-8ff1-3a35327a930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:22.941619 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 126/257] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:22 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Oct 22 20:31:23.094853 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6cc45-877b-4024-9d78-e9ef0461f015 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.095146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6cc45-877b-4024-9d78-e9ef0461f015 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.095473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6cc45-877b-4024-9d78-e9ef0461f015 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.096873 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 132/258] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:23.104156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05f34-37cc-489c-a130-83310fbf4b7a None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.104435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05f34-37cc-489c-a130-83310fbf4b7a None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.105012 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f05f34-37cc-489c-a130-83310fbf4b7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.132246 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-d0f05f34-37cc-489c-a130-83310fbf4b7a None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:23.133429 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-d0f05f34-37cc-489c-a130-83310fbf4b7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:23.141532 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 127/259] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 20:31:23.215456 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462a45-1915-460a-b1ff-d949762f91db None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.215789 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462a45-1915-460a-b1ff-d949762f91db None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.216043 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03462a45-1915-460a-b1ff-d949762f91db None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.217653 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 133/260] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:23.228230 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f79749-30f7-4cda-a223-42570fcc2962 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.228509 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f79749-30f7-4cda-a223-42570fcc2962 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.228758 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f79749-30f7-4cda-a223-42570fcc2962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.253494 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-24f79749-30f7-4cda-a223-42570fcc2962 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:23.254667 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-24f79749-30f7-4cda-a223-42570fcc2962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:23.266744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 128/261] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 20:31:23.545644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b374c-01fa-4a1f-8fe2-6e9afe03c0c4 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.546012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b374c-01fa-4a1f-8fe2-6e9afe03c0c4 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.546177 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56b374c-01fa-4a1f-8fe2-6e9afe03c0c4 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.547800 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 134/262] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:23.553080 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e3c41-01d6-47b5-90a0-cb374be549c1 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.553354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e3c41-01d6-47b5-90a0-cb374be549c1 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.553618 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889e3c41-01d6-47b5-90a0-cb374be549c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.569264 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b374c-01fa-4a1f-8fe2-6e9afe03c0c4 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.573073 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:23.583999 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-889e3c41-01d6-47b5-90a0-cb374be549c1 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:23.585283 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-889e3c41-01d6-47b5-90a0-cb374be549c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:23.586301 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56b374c-01fa-4a1f-8fe2-6e9afe03c0c4 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.591923 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d057b5e-2205-4088-af0c-046b377f5c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:23.592558 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d057b5e-2205-4088-af0c-046b377f5c87 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.592835 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d057b5e-2205-4088-af0c-046b377f5c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.593109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d057b5e-2205-4088-af0c-046b377f5c87 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.616247 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d057b5e-2205-4088-af0c-046b377f5c87 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-6d057b5e-2205-4088-af0c-046b377f5c87 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:23.621055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:23.621898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:23.622655 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 135/263] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Oct 22 20:31:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 53 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:23.628498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d057b5e-2205-4088-af0c-046b377f5c87 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.640817 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d057b5e-2205-4088-af0c-046b377f5c87 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.662229 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:23.662915 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.663190 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.663483 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.664149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:23.664439 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:23.666225 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WARNING py.warnings [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:31:23.666225 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: warnings.warn(msg) Oct 22 20:31:23.666225 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: Oct 22 20:31:23.667130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:23.681952 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 136/264] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Oct 22 20:31:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:23.691503 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 129/265] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:23.693416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.707042 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b0dc87-85e1-4532-8192-501e6be58bd3 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.715394 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84261de0-2fb6-42e7-81b2-c9f39c0c4bae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:23.716041 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261de0-2fb6-42e7-81b2-c9f39c0c4bae admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.716320 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261de0-2fb6-42e7-81b2-c9f39c0c4bae admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.716591 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84261de0-2fb6-42e7-81b2-c9f39c0c4bae admin admin] PATH_INFO: `/v3/groups/12041efd3a9541858608f9652a730041` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.721714 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e3c41-01d6-47b5-90a0-cb374be549c1 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.725787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84261de0-2fb6-42e7-81b2-c9f39c0c4bae admin admin] RBAC: Authorizing `identity:get_group(group_id=12041efd3a9541858608f9652a730041)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:23.726830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WARNING py.warnings [None req-84261de0-2fb6-42e7-81b2-c9f39c0c4bae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:31:23.726830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: warnings.warn(msg) Oct 22 20:31:23.726830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: Oct 22 20:31:23.728891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84261de0-2fb6-42e7-81b2-c9f39c0c4bae admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:23.731232 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 137/266] 10.222.0.39 () {56 vars in 1201 bytes} [Sat Oct 22 20:31:23 2022] GET /identity/v3/groups/12041efd3a9541858608f9652a730041 => generated 226 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:23.736745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84261de0-2fb6-42e7-81b2-c9f39c0c4bae admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.740328 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889e3c41-01d6-47b5-90a0-cb374be549c1 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.748765 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb6820-a1be-451a-89a6-ca7a97528628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:23.749407 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb6820-a1be-451a-89a6-ca7a97528628 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.749678 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb6820-a1be-451a-89a6-ca7a97528628 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.749939 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb6820-a1be-451a-89a6-ca7a97528628 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.750249 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84261de0-2fb6-42e7-81b2-c9f39c0c4bae admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.759122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86741658-ed6f-49eb-88f8-fd80ffa7ca0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:23.759781 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86741658-ed6f-49eb-88f8-fd80ffa7ca0c admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.760060 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86741658-ed6f-49eb-88f8-fd80ffa7ca0c admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.760698 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86741658-ed6f-49eb-88f8-fd80ffa7ca0c admin admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.761845 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86741658-ed6f-49eb-88f8-fd80ffa7ca0c admin admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:23.764290 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86741658-ed6f-49eb-88f8-fd80ffa7ca0c admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:23.765941 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 138/267] 10.222.0.39 () {56 vars in 1207 bytes} [Sat Oct 22 20:31:23 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:23.772056 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86741658-ed6f-49eb-88f8-fd80ffa7ca0c admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.780319 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb6820-a1be-451a-89a6-ca7a97528628 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:23.784933 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86741658-ed6f-49eb-88f8-fd80ffa7ca0c admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-aebb6820-a1be-451a-89a6-ca7a97528628 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:23.785233 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:23.787245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:23.789129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 130/268] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Oct 22 20:31:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 65 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:23.790715 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5c23-060c-4067-9438-af39bce938cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:23.794981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb6820-a1be-451a-89a6-ca7a97528628 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.795193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5c23-060c-4067-9438-af39bce938cd admin admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.795193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5c23-060c-4067-9438-af39bce938cd admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.795193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fa5c23-060c-4067-9438-af39bce938cd admin admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/groups/12041efd3a9541858608f9652a730041/roles/717e33c007ba49a5af257abafa205f0f` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.795635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa5c23-060c-4067-9438-af39bce938cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64a8a99b0dd46f0beb4750f34503fcd, group_id=12041efd3a9541858608f9652a730041, role_id=717e33c007ba49a5af257abafa205f0f)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:23.796605 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WARNING py.warnings [None req-f8fa5c23-060c-4067-9438-af39bce938cd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:31:23.796605 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: warnings.warn(msg) Oct 22 20:31:23.796605 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: Oct 22 20:31:23.798832 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fa5c23-060c-4067-9438-af39bce938cd admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:23.812592 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb6820-a1be-451a-89a6-ca7a97528628 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.822698 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:23.823485 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.823766 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.824040 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.824719 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] RBAC: Adding query filter params (name=member) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:23.825016 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:23.826829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING py.warnings [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:31:23.826829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: warnings.warn(msg) Oct 22 20:31:23.826829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: Oct 22 20:31:23.827782 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:23.830021 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 139/269] 10.222.0.39 () {58 vars in 1463 bytes} [Sat Oct 22 20:31:23 2022] PUT /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/groups/12041efd3a9541858608f9652a730041/roles/717e33c007ba49a5af257abafa205f0f => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:31:23.847369 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 131/270] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Oct 22 20:31:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:23.853170 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5c23-060c-4067-9438-af39bce938cd admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.948646 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fa5c23-060c-4067-9438-af39bce938cd admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.953374 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3346a-c241-4e93-982c-a210c8363f4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:23.954032 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3346a-c241-4e93-982c-a210c8363f4d admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.954311 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3346a-c241-4e93-982c-a210c8363f4d admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.954582 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a3346a-c241-4e93-982c-a210c8363f4d admin admin] PATH_INFO: `/v3/groups/12041efd3a9541858608f9652a730041` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:23.955832 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3346a-c241-4e93-982c-a210c8363f4d admin admin] RBAC: Authorizing `identity:get_group(group_id=12041efd3a9541858608f9652a730041)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:23.957808 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a3346a-c241-4e93-982c-a210c8363f4d admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:23.959918 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 140/271] 10.222.0.39 () {56 vars in 1201 bytes} [Sat Oct 22 20:31:23 2022] GET /identity/v3/groups/12041efd3a9541858608f9652a730041 => generated 226 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:23.965212 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.969103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3346a-c241-4e93-982c-a210c8363f4d admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:23.982212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a3346a-c241-4e93-982c-a210c8363f4d admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.989927 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab8ae3b-3c21-412b-ae79-b3345bc31172 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:23.991497 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebeda6c-555f-4365-ab65-277da708cf22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:23.992174 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebeda6c-555f-4365-ab65-277da708cf22 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:23.992746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebeda6c-555f-4365-ab65-277da708cf22 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:23.993023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebeda6c-555f-4365-ab65-277da708cf22 admin admin] PATH_INFO: `/v3/roles/member` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.002258 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9026c9-935f-4148-9f28-5543f814af62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:24.002908 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9026c9-935f-4148-9f28-5543f814af62 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:24.003182 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9026c9-935f-4148-9f28-5543f814af62 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:24.003478 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9026c9-935f-4148-9f28-5543f814af62 admin admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.005707 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9026c9-935f-4148-9f28-5543f814af62 admin admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:24.007784 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebeda6c-555f-4365-ab65-277da708cf22 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:24.007970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9026c9-935f-4148-9f28-5543f814af62 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:24.009859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 132/272] 10.222.0.39 () {56 vars in 1207 bytes} [Sat Oct 22 20:31:23 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:24.015715 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9026c9-935f-4148-9f28-5543f814af62 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-8ebeda6c-555f-4365-ab65-277da708cf22 admin admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:24.016625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:24.018565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:24.020495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 141/273] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Oct 22 20:31:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:31:24.027294 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebeda6c-555f-4365-ab65-277da708cf22 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:24.033721 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9026c9-935f-4148-9f28-5543f814af62 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:24.037785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebeda6c-555f-4365-ab65-277da708cf22 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:24.048205 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a49eb-c76b-4291-bfa6-886fc4efca59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:24.048896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a49eb-c76b-4291-bfa6-886fc4efca59 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:24.049172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a49eb-c76b-4291-bfa6-886fc4efca59 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:24.049433 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0a49eb-c76b-4291-bfa6-886fc4efca59 admin admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.050151 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a49eb-c76b-4291-bfa6-886fc4efca59 admin admin] RBAC: Adding query filter params (name=member) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:24.050442 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a49eb-c76b-4291-bfa6-886fc4efca59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:24.051954 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9011-9da7-4910-befe-f2f2654fbc28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:24.052198 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0a49eb-c76b-4291-bfa6-886fc4efca59 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:24.052693 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9011-9da7-4910-befe-f2f2654fbc28 admin admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:24.052969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9011-9da7-4910-befe-f2f2654fbc28 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:24.053234 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948f9011-9da7-4910-befe-f2f2654fbc28 admin admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/groups/12041efd3a9541858608f9652a730041/roles/72c390b29d3240dd8c46b0fd1b18441e` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.056132 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f9011-9da7-4910-befe-f2f2654fbc28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64a8a99b0dd46f0beb4750f34503fcd, group_id=12041efd3a9541858608f9652a730041, role_id=72c390b29d3240dd8c46b0fd1b18441e)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:24.057164 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING py.warnings [None req-948f9011-9da7-4910-befe-f2f2654fbc28 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:31:24.057164 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: warnings.warn(msg) Oct 22 20:31:24.057164 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: Oct 22 20:31:24.059111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948f9011-9da7-4910-befe-f2f2654fbc28 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:24.066450 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 142/274] 10.222.0.39 () {56 vars in 1122 bytes} [Sat Oct 22 20:31:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:24.074705 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a49eb-c76b-4291-bfa6-886fc4efca59 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:24.088240 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 133/275] 10.222.0.39 () {58 vars in 1463 bytes} [Sat Oct 22 20:31:24 2022] PUT /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd/groups/12041efd3a9541858608f9652a730041/roles/72c390b29d3240dd8c46b0fd1b18441e => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:31:24.092073 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0a49eb-c76b-4291-bfa6-886fc4efca59 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:24.134571 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:24.170670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725962a-6f01-469c-81a3-4a306498845f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:24.171322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725962a-6f01-469c-81a3-4a306498845f admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:24.171600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725962a-6f01-469c-81a3-4a306498845f admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:24.171915 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2725962a-6f01-469c-81a3-4a306498845f admin admin] PATH_INFO: `/v3/groups/12041efd3a9541858608f9652a730041` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.174994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725962a-6f01-469c-81a3-4a306498845f admin admin] RBAC: Authorizing `identity:get_group(group_id=12041efd3a9541858608f9652a730041)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:24.176968 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2725962a-6f01-469c-81a3-4a306498845f admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:24.178891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 143/276] 10.222.0.39 () {56 vars in 1201 bytes} [Sat Oct 22 20:31:24 2022] GET /identity/v3/groups/12041efd3a9541858608f9652a730041 => generated 226 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:24.184575 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9011-9da7-4910-befe-f2f2654fbc28 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:24.206045 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948f9011-9da7-4910-befe-f2f2654fbc28 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:24.214993 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bdc50-4296-43cb-a2f9-7463987e376e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:24.215659 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bdc50-4296-43cb-a2f9-7463987e376e admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:24.215934 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bdc50-4296-43cb-a2f9-7463987e376e admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:24.216196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bdc50-4296-43cb-a2f9-7463987e376e admin admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.220255 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bdc50-4296-43cb-a2f9-7463987e376e admin admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:24.222491 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bdc50-4296-43cb-a2f9-7463987e376e admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:24.224732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 134/277] 10.222.0.39 () {56 vars in 1207 bytes} [Sat Oct 22 20:31:24 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:24.230701 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725962a-6f01-469c-81a3-4a306498845f admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:24.244852 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bdc50-4296-43cb-a2f9-7463987e376e admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:24.245155 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2725962a-6f01-469c-81a3-4a306498845f admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:24.258582 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15cc0-40ef-4fac-be04-9b4b14cfbef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:24.259293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15cc0-40ef-4fac-be04-9b4b14cfbef4 admin admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:24.259564 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15cc0-40ef-4fac-be04-9b4b14cfbef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:24.259902 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f15cc0-40ef-4fac-be04-9b4b14cfbef4 admin admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850/groups/12041efd3a9541858608f9652a730041/roles/72c390b29d3240dd8c46b0fd1b18441e` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.267420 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15cc0-40ef-4fac-be04-9b4b14cfbef4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadc8205943c46cfaec67ba17ede1850, group_id=12041efd3a9541858608f9652a730041, role_id=72c390b29d3240dd8c46b0fd1b18441e)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:24.272954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f15cc0-40ef-4fac-be04-9b4b14cfbef4 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:24.305211 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 144/278] 10.222.0.39 () {58 vars in 1463 bytes} [Sat Oct 22 20:31:24 2022] PUT /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850/groups/12041efd3a9541858608f9652a730041/roles/72c390b29d3240dd8c46b0fd1b18441e => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:31:24.395168 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:24.400830 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bdc50-4296-43cb-a2f9-7463987e376e admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:24.442247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bd93c-df67-4c98-b4a9-0ef06fc6888d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:24.442247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bd93c-df67-4c98-b4a9-0ef06fc6888d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:24.442247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bd93c-df67-4c98-b4a9-0ef06fc6888d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:24.442562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bd93c-df67-4c98-b4a9-0ef06fc6888d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.456792 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bd93c-df67-4c98-b4a9-0ef06fc6888d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-211bd93c-df67-4c98-b4a9-0ef06fc6888d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:24.462299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:24.463202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:24.464001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 135/279] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:31:24.471813 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15cc0-40ef-4fac-be04-9b4b14cfbef4 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:24.640350 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f15cc0-40ef-4fac-be04-9b4b14cfbef4 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:24.684472 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c65e88-88e5-4d41-ae55-3b888be0a7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:24.685089 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c65e88-88e5-4d41-ae55-3b888be0a7f6 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:24.685370 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c65e88-88e5-4d41-ae55-3b888be0a7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:24.685639 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c65e88-88e5-4d41-ae55-3b888be0a7f6 None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.686321 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c65e88-88e5-4d41-ae55-3b888be0a7f6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:24.686620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c65e88-88e5-4d41-ae55-3b888be0a7f6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:24.688047 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c65e88-88e5-4d41-ae55-3b888be0a7f6 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:24.698152 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 145/280] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:24.704524 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bd93c-df67-4c98-b4a9-0ef06fc6888d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:24.850482 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bd93c-df67-4c98-b4a9-0ef06fc6888d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:24.886011 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d627d06c-3932-4afa-b02e-ff81dca807ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:24.886662 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627d06c-3932-4afa-b02e-ff81dca807ac None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:24.886939 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627d06c-3932-4afa-b02e-ff81dca807ac None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:24.887208 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d627d06c-3932-4afa-b02e-ff81dca807ac None admin] PATH_INFO: `/v3/users/36fd94517b3b450881832e8edc7164b5` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:24.888373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627d06c-3932-4afa-b02e-ff81dca807ac None admin] RBAC: Authorizing `identity:get_user(user_id=36fd94517b3b450881832e8edc7164b5)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:24.889839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d627d06c-3932-4afa-b02e-ff81dca807ac None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:24.895656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 136/281] 10.222.0.39 () {56 vars in 1177 bytes} [Sat Oct 22 20:31:24 2022] GET /identity/v3/users/36fd94517b3b450881832e8edc7164b5 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:24.899146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c65e88-88e5-4d41-ae55-3b888be0a7f6 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:24.953007 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:25.058972 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c65e88-88e5-4d41-ae55-3b888be0a7f6 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:25.102834 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6841e68-7ad6-42c4-8c75-b75bc889d24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:25.103423 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6841e68-7ad6-42c4-8c75-b75bc889d24a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:25.103682 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6841e68-7ad6-42c4-8c75-b75bc889d24a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:25.103951 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6841e68-7ad6-42c4-8c75-b75bc889d24a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:25.105055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6841e68-7ad6-42c4-8c75-b75bc889d24a None admin] RBAC: Adding query filter params (role.id=30f9bb25296e4cc3b8956272e117845e, user.id=36fd94517b3b450881832e8edc7164b5, scope.system=all) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:25.105363 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6841e68-7ad6-42c4-8c75-b75bc889d24a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:25.106817 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6841e68-7ad6-42c4-8c75-b75bc889d24a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:25.123834 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 146/282] 10.222.0.39 () {56 vars in 1308 bytes} [Sat Oct 22 20:31:24 2022] GET /identity/v3/role_assignments?user.id=36fd94517b3b450881832e8edc7164b5&scope.system=all&role.id=30f9bb25296e4cc3b8956272e117845e => generated 510 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:25.309150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02233c6-e3f3-402f-8703-465269dd3752 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:25.309549 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02233c6-e3f3-402f-8703-465269dd3752 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:25.309751 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02233c6-e3f3-402f-8703-465269dd3752 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:25.311108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 137/283] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:25.317043 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af61abd-1628-474f-b303-8a1c5b06fe65 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:25.317362 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af61abd-1628-474f-b303-8a1c5b06fe65 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:25.317594 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af61abd-1628-474f-b303-8a1c5b06fe65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:25.340474 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-3af61abd-1628-474f-b303-8a1c5b06fe65 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:25.341801 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-3af61abd-1628-474f-b303-8a1c5b06fe65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:25.427192 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 147/284] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 20:31:25.863238 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02233c6-e3f3-402f-8703-465269dd3752 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:25.875944 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02233c6-e3f3-402f-8703-465269dd3752 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:25.884416 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbf0c-64ee-4bfe-af81-2fbfe4a76fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:25.885055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbf0c-64ee-4bfe-af81-2fbfe4a76fc2 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:25.885330 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbf0c-64ee-4bfe-af81-2fbfe4a76fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:25.885597 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbadbf0c-64ee-4bfe-af81-2fbfe4a76fc2 admin admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:25.897574 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbadbf0c-64ee-4bfe-af81-2fbfe4a76fc2 admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-cbadbf0c-64ee-4bfe-af81-2fbfe4a76fc2 admin admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:25.905743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:25.906616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:25.907394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 138/285] 10.222.0.39 () {56 vars in 1135 bytes} [Sat Oct 22 20:31:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 44 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:25.912997 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af61abd-1628-474f-b303-8a1c5b06fe65 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:25.929060 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af61abd-1628-474f-b303-8a1c5b06fe65 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:25.933580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36ba1-56d5-4145-ac11-392f60ebafb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:25.934204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36ba1-56d5-4145-ac11-392f60ebafb5 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:25.934484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36ba1-56d5-4145-ac11-392f60ebafb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:25.934754 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e36ba1-56d5-4145-ac11-392f60ebafb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:25.935494 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36ba1-56d5-4145-ac11-392f60ebafb5 admin admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:25.935796 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36ba1-56d5-4145-ac11-392f60ebafb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:25.937437 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e36ba1-56d5-4145-ac11-392f60ebafb5 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:25.950195 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 148/286] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Oct 22 20:31:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:25.955916 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbf0c-64ee-4bfe-af81-2fbfe4a76fc2 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:25.966165 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbadbf0c-64ee-4bfe-af81-2fbfe4a76fc2 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:25.970594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735714d6-4afe-476e-9962-ed72d65b6e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:25.971230 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735714d6-4afe-476e-9962-ed72d65b6e8b admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:25.975636 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735714d6-4afe-476e-9962-ed72d65b6e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:25.975918 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735714d6-4afe-476e-9962-ed72d65b6e8b admin admin] PATH_INFO: `/v3/groups/12041efd3a9541858608f9652a730041` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:25.977181 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735714d6-4afe-476e-9962-ed72d65b6e8b admin admin] RBAC: Authorizing `identity:get_group(group_id=12041efd3a9541858608f9652a730041)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:25.978287 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING py.warnings [None req-735714d6-4afe-476e-9962-ed72d65b6e8b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:get_group": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.group.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:31:25.978287 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: warnings.warn(msg) Oct 22 20:31:25.978287 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: Oct 22 20:31:25.979925 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735714d6-4afe-476e-9962-ed72d65b6e8b admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:25.981621 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 139/287] 10.222.0.39 () {56 vars in 1201 bytes} [Sat Oct 22 20:31:25 2022] GET /identity/v3/groups/12041efd3a9541858608f9652a730041 => generated 226 bytes in 26 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:25.987461 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36ba1-56d5-4145-ac11-392f60ebafb5 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:26.000451 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e36ba1-56d5-4145-ac11-392f60ebafb5 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:26.004900 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b89a69-9d82-49bb-bea9-d37789b01c8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:26.005628 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89a69-9d82-49bb-bea9-d37789b01c8a admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:26.005928 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89a69-9d82-49bb-bea9-d37789b01c8a admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:26.006172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b89a69-9d82-49bb-bea9-d37789b01c8a admin admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:26.007333 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b89a69-9d82-49bb-bea9-d37789b01c8a admin admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:26.009422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b89a69-9d82-49bb-bea9-d37789b01c8a admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:26.011042 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 149/288] 10.222.0.39 () {56 vars in 1207 bytes} [Sat Oct 22 20:31:25 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:26.016885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735714d6-4afe-476e-9962-ed72d65b6e8b admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:26.027067 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735714d6-4afe-476e-9962-ed72d65b6e8b admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:26.035533 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02adefe-5cac-499f-a8e8-14d7ff6cc2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:26.036217 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02adefe-5cac-499f-a8e8-14d7ff6cc2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:26.036503 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02adefe-5cac-499f-a8e8-14d7ff6cc2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:26.036830 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02adefe-5cac-499f-a8e8-14d7ff6cc2b8 admin admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850/groups/12041efd3a9541858608f9652a730041/roles/717e33c007ba49a5af257abafa205f0f` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:26.039051 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02adefe-5cac-499f-a8e8-14d7ff6cc2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eadc8205943c46cfaec67ba17ede1850, group_id=12041efd3a9541858608f9652a730041, role_id=717e33c007ba49a5af257abafa205f0f)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:26.041773 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02adefe-5cac-499f-a8e8-14d7ff6cc2b8 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:26.046226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:26.062081 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 140/289] 10.222.0.39 () {58 vars in 1463 bytes} [Sat Oct 22 20:31:26 2022] PUT /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850/groups/12041efd3a9541858608f9652a730041/roles/717e33c007ba49a5af257abafa205f0f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:31:26.105312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ea48-af61-4a3c-8f53-48199557fbc2 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:26.105592 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ea48-af61-4a3c-8f53-48199557fbc2 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:26.105864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb0ea48-af61-4a3c-8f53-48199557fbc2 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:26.107525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 150/290] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:26.113407 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809b17-1d22-46d9-88a4-d659e1b9c37f None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:26.113602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809b17-1d22-46d9-88a4-d659e1b9c37f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:26.113869 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9809b17-1d22-46d9-88a4-d659e1b9c37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:26.134464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-d9809b17-1d22-46d9-88a4-d659e1b9c37f None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:26.135730 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-d9809b17-1d22-46d9-88a4-d659e1b9c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:26.200130 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 141/291] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Oct 22 20:31:26.617341 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0ea48-af61-4a3c-8f53-48199557fbc2 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:26.633570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb0ea48-af61-4a3c-8f53-48199557fbc2 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:26.637889 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f47248-7515-427b-8875-512a811138fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:26.638524 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f47248-7515-427b-8875-512a811138fc admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:26.638800 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f47248-7515-427b-8875-512a811138fc admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:26.639070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f47248-7515-427b-8875-512a811138fc admin admin] PATH_INFO: `/v3/roles/admin` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:26.655797 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f47248-7515-427b-8875-512a811138fc admin admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-94f47248-7515-427b-8875-512a811138fc admin admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:26.660959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:26.662018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:26.662945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:26.664545 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 151/292] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Oct 22 20:31:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 45 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:26.669388 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9809b17-1d22-46d9-88a4-d659e1b9c37f None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:26.679086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9809b17-1d22-46d9-88a4-d659e1b9c37f None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:26.683656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f733dc6-4ac3-4b41-9747-696cd832ed0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:26.684267 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f733dc6-4ac3-4b41-9747-696cd832ed0f admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:26.684539 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f733dc6-4ac3-4b41-9747-696cd832ed0f admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:26.684807 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f733dc6-4ac3-4b41-9747-696cd832ed0f admin admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:26.685475 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f733dc6-4ac3-4b41-9747-696cd832ed0f admin admin] RBAC: Adding query filter params (name=admin) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:26.685773 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f733dc6-4ac3-4b41-9747-696cd832ed0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:26.691477 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f733dc6-4ac3-4b41-9747-696cd832ed0f admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:26.701058 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 142/293] 10.222.0.39 () {56 vars in 1120 bytes} [Sat Oct 22 20:31:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:26.706734 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f47248-7515-427b-8875-512a811138fc admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:26.720468 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f47248-7515-427b-8875-512a811138fc admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:26.724988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985ba2f-15e0-44b2-8094-78cb0d2403db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:26.725624 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985ba2f-15e0-44b2-8094-78cb0d2403db admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:26.725899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985ba2f-15e0-44b2-8094-78cb0d2403db admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:26.726171 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5985ba2f-15e0-44b2-8094-78cb0d2403db admin admin] PATH_INFO: `/v3/groups/c54a424c95d54589973c2a5798911344` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:26.732346 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:26.735805 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985ba2f-15e0-44b2-8094-78cb0d2403db admin admin] RBAC: Authorizing `identity:get_group(group_id=c54a424c95d54589973c2a5798911344)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:26.737954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5985ba2f-15e0-44b2-8094-78cb0d2403db admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:26.740445 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 152/294] 10.222.0.39 () {56 vars in 1201 bytes} [Sat Oct 22 20:31:26 2022] GET /identity/v3/groups/c54a424c95d54589973c2a5798911344 => generated 229 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:26.745712 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f733dc6-4ac3-4b41-9747-696cd832ed0f admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:26.755896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f733dc6-4ac3-4b41-9747-696cd832ed0f admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:26.761890 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b2a09d-1af6-4ed1-83c5-103c0985b69e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:26.762517 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2a09d-1af6-4ed1-83c5-103c0985b69e admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:26.762792 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2a09d-1af6-4ed1-83c5-103c0985b69e admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:26.763057 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b2a09d-1af6-4ed1-83c5-103c0985b69e admin admin] PATH_INFO: `/v3/projects/9729266775c4452a92f26be4932200ad` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:26.764203 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2a09d-1af6-4ed1-83c5-103c0985b69e admin admin] RBAC: Authorizing `identity:get_project(project_id=9729266775c4452a92f26be4932200ad)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:26.766035 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b2a09d-1af6-4ed1-83c5-103c0985b69e admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:26.768015 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 143/295] 10.222.0.39 () {56 vars in 1207 bytes} [Sat Oct 22 20:31:26 2022] GET /identity/v3/projects/9729266775c4452a92f26be4932200ad => generated 344 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:26.773445 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985ba2f-15e0-44b2-8094-78cb0d2403db admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:26.785328 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5985ba2f-15e0-44b2-8094-78cb0d2403db admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:26.789828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2dd1b3-110f-4a45-8da1-421826524332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:26.790500 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dd1b3-110f-4a45-8da1-421826524332 admin admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:26.790777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dd1b3-110f-4a45-8da1-421826524332 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:26.791049 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2dd1b3-110f-4a45-8da1-421826524332 admin admin] PATH_INFO: `/v3/projects/9729266775c4452a92f26be4932200ad/groups/c54a424c95d54589973c2a5798911344/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:26.793038 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dd1b3-110f-4a45-8da1-421826524332 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9729266775c4452a92f26be4932200ad, group_id=c54a424c95d54589973c2a5798911344, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:26.795939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2dd1b3-110f-4a45-8da1-421826524332 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:26.818857 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 153/296] 10.222.0.39 () {58 vars in 1463 bytes} [Sat Oct 22 20:31:26 2022] PUT /identity/v3/projects/9729266775c4452a92f26be4932200ad/groups/c54a424c95d54589973c2a5798911344/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:31:27.424595 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace28fb5-63b2-4338-8c2f-ec4f0dc1fda1 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:27.425249 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace28fb5-63b2-4338-8c2f-ec4f0dc1fda1 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:27.425249 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace28fb5-63b2-4338-8c2f-ec4f0dc1fda1 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:27.426622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 144/297] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:27.432620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9eb34-9cfd-4132-ba3a-54ed0459fd69 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:27.433161 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9eb34-9cfd-4132-ba3a-54ed0459fd69 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:27.433161 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa9eb34-9cfd-4132-ba3a-54ed0459fd69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:27.456547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-1fa9eb34-9cfd-4132-ba3a-54ed0459fd69 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:27.457735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-1fa9eb34-9cfd-4132-ba3a-54ed0459fd69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:27.503146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a041-1de5-4976-9c65-5054f5529c7c None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:27.503507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a041-1de5-4976-9c65-5054f5529c7c None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:27.503691 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a8a041-1de5-4976-9c65-5054f5529c7c None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:27.505227 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 145/298] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:31:27.516104 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409fde1-1b15-4f50-ba09-27943ead4872 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:27.516417 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409fde1-1b15-4f50-ba09-27943ead4872 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:27.516649 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409fde1-1b15-4f50-ba09-27943ead4872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:27.546122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-1409fde1-1b15-4f50-ba09-27943ead4872 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:27.549088 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-1409fde1-1b15-4f50-ba09-27943ead4872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:27.590374 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 154/299] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:27.645617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 146/300] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:27.964633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a32583-ba4d-4dbe-afe5-53777ca046c0 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:27.965000 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a32583-ba4d-4dbe-afe5-53777ca046c0 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:27.965161 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a32583-ba4d-4dbe-afe5-53777ca046c0 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:27.966765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 155/301] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:27.972533 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed089b-871c-47a8-b526-4e39e5a04ec9 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:27.972866 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed089b-871c-47a8-b526-4e39e5a04ec9 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:27.973139 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ed089b-871c-47a8-b526-4e39e5a04ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:27.994058 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-10ed089b-871c-47a8-b526-4e39e5a04ec9 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:27.995269 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-10ed089b-871c-47a8-b526-4e39e5a04ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:28.008855 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a32583-ba4d-4dbe-afe5-53777ca046c0 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:28.047681 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:28.071697 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 147/302] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:28.150367 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a32583-ba4d-4dbe-afe5-53777ca046c0 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:28.171829 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:28.182896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed089b-871c-47a8-b526-4e39e5a04ec9 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:28.203470 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ceb72b-e1db-48ba-bfec-6458b1441565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:28.204572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ceb72b-e1db-48ba-bfec-6458b1441565 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:28.205972 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ceb72b-e1db-48ba-bfec-6458b1441565 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:28.207209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ceb72b-e1db-48ba-bfec-6458b1441565 None admin] PATH_INFO: `/v3/roles/member` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:28.229323 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ceb72b-e1db-48ba-bfec-6458b1441565 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-05ceb72b-e1db-48ba-bfec-6458b1441565 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:28.235204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:28.236108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:28.236910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:28.240637 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 156/303] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:28.246728 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ceb72b-e1db-48ba-bfec-6458b1441565 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:28.319302 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ed089b-871c-47a8-b526-4e39e5a04ec9 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:28.353894 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafe21-ee9f-4c16-9e25-c5a0415e111a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:28.354866 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafe21-ee9f-4c16-9e25-c5a0415e111a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:28.355142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafe21-ee9f-4c16-9e25-c5a0415e111a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:28.357311 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fafe21-ee9f-4c16-9e25-c5a0415e111a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:28.368424 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fafe21-ee9f-4c16-9e25-c5a0415e111a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-56fafe21-ee9f-4c16-9e25-c5a0415e111a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:28.373420 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:28.374304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:28.375064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 148/304] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:31:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:31:28.384520 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafe21-ee9f-4c16-9e25-c5a0415e111a None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:28.420163 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ceb72b-e1db-48ba-bfec-6458b1441565 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:28.436606 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:28.474831 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c435c92-0f6b-44d5-aeb3-a5a8aeb5b9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:28.476248 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c435c92-0f6b-44d5-aeb3-a5a8aeb5b9cb None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:28.476740 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c435c92-0f6b-44d5-aeb3-a5a8aeb5b9cb None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:28.477302 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c435c92-0f6b-44d5-aeb3-a5a8aeb5b9cb None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:28.478261 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c435c92-0f6b-44d5-aeb3-a5a8aeb5b9cb None admin] RBAC: Adding query filter params (name=member) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:28.478882 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c435c92-0f6b-44d5-aeb3-a5a8aeb5b9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:28.480958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c435c92-0f6b-44d5-aeb3-a5a8aeb5b9cb None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:28.500349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 157/305] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:28.501951 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fafe21-ee9f-4c16-9e25-c5a0415e111a None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:28.506820 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c435c92-0f6b-44d5-aeb3-a5a8aeb5b9cb None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:28.544023 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd3a64-f86b-4ba1-8824-9d9dc3831f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:28.545524 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd3a64-f86b-4ba1-8824-9d9dc3831f6d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:28.545800 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd3a64-f86b-4ba1-8824-9d9dc3831f6d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:28.546077 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dd3a64-f86b-4ba1-8824-9d9dc3831f6d None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:28.546761 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd3a64-f86b-4ba1-8824-9d9dc3831f6d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:28.547051 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd3a64-f86b-4ba1-8824-9d9dc3831f6d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:28.548492 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39dd3a64-f86b-4ba1-8824-9d9dc3831f6d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:28.558728 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 149/306] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:28.565016 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd3a64-f86b-4ba1-8824-9d9dc3831f6d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:28.599085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:28.687953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dd3a64-f86b-4ba1-8824-9d9dc3831f6d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:28.700441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:28.701285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c435c92-0f6b-44d5-aeb3-a5a8aeb5b9cb None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:28.735857 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e38acb-c7d4-4dda-9645-a48d6d12be15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:28.736382 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e38acb-c7d4-4dda-9645-a48d6d12be15 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:28.736662 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e38acb-c7d4-4dda-9645-a48d6d12be15 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:28.736933 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e38acb-c7d4-4dda-9645-a48d6d12be15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:28.744489 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9e346-d887-42ef-84e3-15e84bdc5e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:28.745396 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e346-d887-42ef-84e3-15e84bdc5e7e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:28.745884 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e346-d887-42ef-84e3-15e84bdc5e7e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:28.746475 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c9e346-d887-42ef-84e3-15e84bdc5e7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:28.828069 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e38acb-c7d4-4dda-9645-a48d6d12be15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:28.830336 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e38acb-c7d4-4dda-9645-a48d6d12be15 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:28.832016 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9e346-d887-42ef-84e3-15e84bdc5e7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:28.834566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c9e346-d887-42ef-84e3-15e84bdc5e7e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:28.893743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:28.959111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 150/307] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:28.959824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e38acb-c7d4-4dda-9645-a48d6d12be15 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:28.970749 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:28.971875 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 158/308] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 22 20:31:28.972890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9e346-d887-42ef-84e3-15e84bdc5e7e None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:29.076570 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e38acb-c7d4-4dda-9645-a48d6d12be15 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:29.093819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c9e346-d887-42ef-84e3-15e84bdc5e7e None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:29.113430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451af84e-f44e-424d-af13-378da29284ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:29.114051 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451af84e-f44e-424d-af13-378da29284ab None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.114320 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451af84e-f44e-424d-af13-378da29284ab None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.114579 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451af84e-f44e-424d-af13-378da29284ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.127581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451af84e-f44e-424d-af13-378da29284ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-451af84e-f44e-424d-af13-378da29284ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:29.133325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:29.134446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Oct 22 20:31:29.135226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:29.136009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 151/309] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:29.136905 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451af84e-f44e-424d-af13-378da29284ab None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:29.144899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f90cc-1fde-4157-83da-9e7028dc2012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:29.145625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f90cc-1fde-4157-83da-9e7028dc2012 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.146007 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f90cc-1fde-4157-83da-9e7028dc2012 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.146338 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f90cc-1fde-4157-83da-9e7028dc2012 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.147563 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f90cc-1fde-4157-83da-9e7028dc2012 None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:29.149639 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f90cc-1fde-4157-83da-9e7028dc2012 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:29.152111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 159/310] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:28 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:29.153349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f90cc-1fde-4157-83da-9e7028dc2012 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:29.169128 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:29.219296 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:29.267877 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451af84e-f44e-424d-af13-378da29284ab None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:29.284600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f90cc-1fde-4157-83da-9e7028dc2012 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:29.311694 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5938f-c30b-47cc-b6de-8e6b8c101f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:29.313065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5938f-c30b-47cc-b6de-8e6b8c101f58 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.313481 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5938f-c30b-47cc-b6de-8e6b8c101f58 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.313895 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5938f-c30b-47cc-b6de-8e6b8c101f58 None admin] PATH_INFO: `/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.315185 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5938f-c30b-47cc-b6de-8e6b8c101f58 None admin] RBAC: Authorizing `identity:get_project(project_id=d64a8a99b0dd46f0beb4750f34503fcd)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:29.317337 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5938f-c30b-47cc-b6de-8e6b8c101f58 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:29.319670 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 152/311] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:29 2022] GET /identity/v3/projects/d64a8a99b0dd46f0beb4750f34503fcd => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:29.320720 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5938f-c30b-47cc-b6de-8e6b8c101f58 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:29.336100 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81555d5-c6c9-4367-9f67-b6a1110aaddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:29.336705 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81555d5-c6c9-4367-9f67-b6a1110aaddf None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.337076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81555d5-c6c9-4367-9f67-b6a1110aaddf None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.337463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81555d5-c6c9-4367-9f67-b6a1110aaddf None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.338229 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81555d5-c6c9-4367-9f67-b6a1110aaddf None admin] RBAC: Adding query filter params (name=member) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:29.338626 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81555d5-c6c9-4367-9f67-b6a1110aaddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:29.340161 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81555d5-c6c9-4367-9f67-b6a1110aaddf None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:29.350194 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 160/312] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:31:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:29.355507 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81555d5-c6c9-4367-9f67-b6a1110aaddf None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:29.443594 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:29.459286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5938f-c30b-47cc-b6de-8e6b8c101f58 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:29.484045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81555d5-c6c9-4367-9f67-b6a1110aaddf None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:29.501304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c35067-0ef3-4011-9d97-0ee4e794f0a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:29.502186 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35067-0ef3-4011-9d97-0ee4e794f0a6 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.502620 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35067-0ef3-4011-9d97-0ee4e794f0a6 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.503022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c35067-0ef3-4011-9d97-0ee4e794f0a6 None admin] PATH_INFO: `/v3/groups/12041efd3a9541858608f9652a730041` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.504383 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c35067-0ef3-4011-9d97-0ee4e794f0a6 None admin] RBAC: Authorizing `identity:get_group(group_id=12041efd3a9541858608f9652a730041)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:29.505898 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c35067-0ef3-4011-9d97-0ee4e794f0a6 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:29.507817 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 153/313] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Oct 22 20:31:29 2022] GET /identity/v3/groups/12041efd3a9541858608f9652a730041 => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:29.508970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f573f-40d3-42d8-a23d-185006c08975 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.509244 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f573f-40d3-42d8-a23d-185006c08975 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.509507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f573f-40d3-42d8-a23d-185006c08975 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.510800 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 154/314] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:29.511556 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f573f-40d3-42d8-a23d-185006c08975 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:29.515156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:29.532650 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a261a-bf05-4c06-96d6-a33b964e6e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:29.533634 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a261a-bf05-4c06-96d6-a33b964e6e63 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.534045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a261a-bf05-4c06-96d6-a33b964e6e63 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.534442 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a261a-bf05-4c06-96d6-a33b964e6e63 None admin] PATH_INFO: `/v3/groups/12041efd3a9541858608f9652a730041` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.535748 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a261a-bf05-4c06-96d6-a33b964e6e63 None admin] RBAC: Authorizing `identity:get_group(group_id=12041efd3a9541858608f9652a730041)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:29.537225 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a261a-bf05-4c06-96d6-a33b964e6e63 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:29.538969 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 161/315] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Oct 22 20:31:29 2022] GET /identity/v3/groups/12041efd3a9541858608f9652a730041 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:29.540476 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357420ee-86af-4edf-9d5f-72b893622080 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.540988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357420ee-86af-4edf-9d5f-72b893622080 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.541427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357420ee-86af-4edf-9d5f-72b893622080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.564023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-357420ee-86af-4edf-9d5f-72b893622080 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:29.564820 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-357420ee-86af-4edf-9d5f-72b893622080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:29.651993 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 162/316] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:29.652754 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357420ee-86af-4edf-9d5f-72b893622080 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:29.654429 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f573f-40d3-42d8-a23d-185006c08975 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:29.701740 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bdf4ad-fc9c-4e94-a157-ea397b85bf04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:29.702481 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdf4ad-fc9c-4e94-a157-ea397b85bf04 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.703422 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdf4ad-fc9c-4e94-a157-ea397b85bf04 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.703805 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bdf4ad-fc9c-4e94-a157-ea397b85bf04 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.736221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:29.775556 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357420ee-86af-4edf-9d5f-72b893622080 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:29.798887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdf4ad-fc9c-4e94-a157-ea397b85bf04 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:29.800464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bdf4ad-fc9c-4e94-a157-ea397b85bf04 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:29.804613 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:29.819194 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f639-03ff-4276-8320-16dadb928915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:29.820750 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f639-03ff-4276-8320-16dadb928915 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.821377 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f639-03ff-4276-8320-16dadb928915 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.821856 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f639-03ff-4276-8320-16dadb928915 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.823097 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f639-03ff-4276-8320-16dadb928915 None admin] RBAC: Adding query filter params (group.id=12041efd3a9541858608f9652a730041, role.id=717e33c007ba49a5af257abafa205f0f, scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:29.823638 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f639-03ff-4276-8320-16dadb928915 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:29.825274 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f639-03ff-4276-8320-16dadb928915 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:29.832944 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 163/317] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Oct 22 20:31:29 2022] GET /identity/v3/role_assignments?group.id=12041efd3a9541858608f9652a730041&scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd&role.id=717e33c007ba49a5af257abafa205f0f => generated 611 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:29.834195 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f639-03ff-4276-8320-16dadb928915 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:29.929255 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 155/318] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:29.930566 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3ba7-fc4e-4602-9e77-1e598dd9439f None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:29.930752 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3ba7-fc4e-4602-9e77-1e598dd9439f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:29.931022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756a3ba7-fc4e-4602-9e77-1e598dd9439f None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:29.936201 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 156/319] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:29 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:29.936924 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3ba7-fc4e-4602-9e77-1e598dd9439f None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:29.962498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f639-03ff-4276-8320-16dadb928915 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:29.997481 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:30.005554 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7837aef-bae7-4b69-b75a-a932bf337b1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:30.006626 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837aef-bae7-4b69-b75a-a932bf337b1d None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.007108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837aef-bae7-4b69-b75a-a932bf337b1d None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.007597 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7837aef-bae7-4b69-b75a-a932bf337b1d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.008523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837aef-bae7-4b69-b75a-a932bf337b1d None admin] RBAC: Adding query filter params (group.id=12041efd3a9541858608f9652a730041, role.id=72c390b29d3240dd8c46b0fd1b18441e, scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:30.009047 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837aef-bae7-4b69-b75a-a932bf337b1d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:30.010685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7837aef-bae7-4b69-b75a-a932bf337b1d None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:30.017553 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 164/320] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Oct 22 20:31:29 2022] GET /identity/v3/role_assignments?group.id=12041efd3a9541858608f9652a730041&scope.project.id=d64a8a99b0dd46f0beb4750f34503fcd&role.id=72c390b29d3240dd8c46b0fd1b18441e => generated 611 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:30.023413 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927f9f8-2d1b-4a19-9d80-80cca1e6f406 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.024156 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927f9f8-2d1b-4a19-9d80-80cca1e6f406 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.024684 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927f9f8-2d1b-4a19-9d80-80cca1e6f406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.051311 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756a3ba7-fc4e-4602-9e77-1e598dd9439f None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:30.053489 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-4927f9f8-2d1b-4a19-9d80-80cca1e6f406 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:30.055074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-4927f9f8-2d1b-4a19-9d80-80cca1e6f406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:30.055628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:30.094122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecbc82-01c5-47ae-b3d3-0e1648641ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:30.095129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecbc82-01c5-47ae-b3d3-0e1648641ad1 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.095446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecbc82-01c5-47ae-b3d3-0e1648641ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.095712 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ecbc82-01c5-47ae-b3d3-0e1648641ad1 None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.097168 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecbc82-01c5-47ae-b3d3-0e1648641ad1 None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:30.099309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ecbc82-01c5-47ae-b3d3-0e1648641ad1 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:30.101673 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 157/321] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:29 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:30.102481 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecbc82-01c5-47ae-b3d3-0e1648641ad1 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:30.148228 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 165/322] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:30.149105 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927f9f8-2d1b-4a19-9d80-80cca1e6f406 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:30.235353 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ecbc82-01c5-47ae-b3d3-0e1648641ad1 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:30.275824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577898d-34ca-4f53-b4f3-1833f6447e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:30.276462 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577898d-34ca-4f53-b4f3-1833f6447e38 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.276735 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577898d-34ca-4f53-b4f3-1833f6447e38 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.277000 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577898d-34ca-4f53-b4f3-1833f6447e38 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.290042 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577898d-34ca-4f53-b4f3-1833f6447e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-0577898d-34ca-4f53-b4f3-1833f6447e38 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:30.297010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:30.297914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:30.298668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 158/323] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:31:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:30.305159 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577898d-34ca-4f53-b4f3-1833f6447e38 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:30.324015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927f9f8-2d1b-4a19-9d80-80cca1e6f406 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:30.339430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:30.361493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:30.365746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01904-8955-4e74-83b7-b10e25e155af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:30.366389 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01904-8955-4e74-83b7-b10e25e155af None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.366667 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01904-8955-4e74-83b7-b10e25e155af None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.366938 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c01904-8955-4e74-83b7-b10e25e155af None admin] PATH_INFO: `/v3/groups/12041efd3a9541858608f9652a730041` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.368125 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c01904-8955-4e74-83b7-b10e25e155af None admin] RBAC: Authorizing `identity:get_group(group_id=12041efd3a9541858608f9652a730041)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:30.371227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c01904-8955-4e74-83b7-b10e25e155af None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:30.372647 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 166/324] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Oct 22 20:31:30 2022] GET /identity/v3/groups/12041efd3a9541858608f9652a730041 => generated 226 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:30.379315 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01904-8955-4e74-83b7-b10e25e155af None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:30.443155 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577898d-34ca-4f53-b4f3-1833f6447e38 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:30.492010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a446-ee1b-4cb0-9ef3-7a6d43c49fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:30.492807 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a446-ee1b-4cb0-9ef3-7a6d43c49fba None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.493086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a446-ee1b-4cb0-9ef3-7a6d43c49fba None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.493351 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556a446-ee1b-4cb0-9ef3-7a6d43c49fba None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.494156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a446-ee1b-4cb0-9ef3-7a6d43c49fba None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:30.494470 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a446-ee1b-4cb0-9ef3-7a6d43c49fba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:30.496310 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556a446-ee1b-4cb0-9ef3-7a6d43c49fba None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:30.506162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 159/325] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:30.511680 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a446-ee1b-4cb0-9ef3-7a6d43c49fba None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:30.518131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c01904-8955-4e74-83b7-b10e25e155af None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:30.560158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98ebd5-d31b-4b7c-9f37-04423e1a6111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:30.560761 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ebd5-d31b-4b7c-9f37-04423e1a6111 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.561037 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ebd5-d31b-4b7c-9f37-04423e1a6111 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.561290 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98ebd5-d31b-4b7c-9f37-04423e1a6111 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.562037 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98ebd5-d31b-4b7c-9f37-04423e1a6111 None admin] RBAC: Adding query filter params (group.id=12041efd3a9541858608f9652a730041, role.id=72c390b29d3240dd8c46b0fd1b18441e, scope.project.id=eadc8205943c46cfaec67ba17ede1850) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:30.562441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98ebd5-d31b-4b7c-9f37-04423e1a6111 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:30.563828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98ebd5-d31b-4b7c-9f37-04423e1a6111 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:30.571051 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 167/326] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Oct 22 20:31:30 2022] GET /identity/v3/role_assignments?group.id=12041efd3a9541858608f9652a730041&scope.project.id=eadc8205943c46cfaec67ba17ede1850&role.id=72c390b29d3240dd8c46b0fd1b18441e => generated 611 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:30.576275 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98ebd5-d31b-4b7c-9f37-04423e1a6111 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:30.637209 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:30.649193 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556a446-ee1b-4cb0-9ef3-7a6d43c49fba None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:30.667125 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:30.699164 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce09860-00f7-4c50-9310-2043a7b87a62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:30.699837 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09860-00f7-4c50-9310-2043a7b87a62 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.700107 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09860-00f7-4c50-9310-2043a7b87a62 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.700373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce09860-00f7-4c50-9310-2043a7b87a62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.731624 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98ebd5-d31b-4b7c-9f37-04423e1a6111 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:30.783644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844df713-aec7-44a5-8959-8c21d277ba74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:30.784260 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df713-aec7-44a5-8959-8c21d277ba74 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.784542 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df713-aec7-44a5-8959-8c21d277ba74 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.784807 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844df713-aec7-44a5-8959-8c21d277ba74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.804870 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844df713-aec7-44a5-8959-8c21d277ba74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-844df713-aec7-44a5-8959-8c21d277ba74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:30.810498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:30.811724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:30.812523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:30.813158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce09860-00f7-4c50-9310-2043a7b87a62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:30.816022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce09860-00f7-4c50-9310-2043a7b87a62 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:30.816836 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 168/327] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:31:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:30.817789 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844df713-aec7-44a5-8959-8c21d277ba74 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:30.933183 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:30.943072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 160/328] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Oct 22 20:31:30.949621 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce09860-00f7-4c50-9310-2043a7b87a62 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:30.952042 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844df713-aec7-44a5-8959-8c21d277ba74 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:30.971660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:30.994621 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d2ef-360f-41ff-a168-b71ab698c55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:30.995617 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d2ef-360f-41ff-a168-b71ab698c55c None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:30.995617 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d2ef-360f-41ff-a168-b71ab698c55c None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:30.995801 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef0d2ef-360f-41ff-a168-b71ab698c55c None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:30.996598 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0d2ef-360f-41ff-a168-b71ab698c55c None admin] RBAC: Adding query filter params (name=admin) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:30.997595 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0d2ef-360f-41ff-a168-b71ab698c55c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:30.998300 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef0d2ef-360f-41ff-a168-b71ab698c55c None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:31.010135 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 169/329] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:31.016286 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d2ef-360f-41ff-a168-b71ab698c55c None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:31.075293 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce09860-00f7-4c50-9310-2043a7b87a62 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:31.118449 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8a57-ea00-49ff-9ad2-2e91c0cf4917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:31.119077 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8a57-ea00-49ff-9ad2-2e91c0cf4917 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:31.119378 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8a57-ea00-49ff-9ad2-2e91c0cf4917 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:31.119643 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bf8a57-ea00-49ff-9ad2-2e91c0cf4917 None admin] PATH_INFO: `/v3/projects/eadc8205943c46cfaec67ba17ede1850` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:31.120770 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf8a57-ea00-49ff-9ad2-2e91c0cf4917 None admin] RBAC: Authorizing `identity:get_project(project_id=eadc8205943c46cfaec67ba17ede1850)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:31.122293 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bf8a57-ea00-49ff-9ad2-2e91c0cf4917 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:31.124179 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 161/330] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:30 2022] GET /identity/v3/projects/eadc8205943c46cfaec67ba17ede1850 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:31.131623 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8a57-ea00-49ff-9ad2-2e91c0cf4917 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:31.141408 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef0d2ef-360f-41ff-a168-b71ab698c55c None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:31.183536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fb178-a546-41e4-929a-022b36bf9996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:31.184153 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fb178-a546-41e4-929a-022b36bf9996 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:31.184417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fb178-a546-41e4-929a-022b36bf9996 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:31.184677 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60fb178-a546-41e4-929a-022b36bf9996 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:31.204103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:31.249466 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:31.250752 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bf8a57-ea00-49ff-9ad2-2e91c0cf4917 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:31.275949 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fb178-a546-41e4-929a-022b36bf9996 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:31.277127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60fb178-a546-41e4-929a-022b36bf9996 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:31.296422 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34973b4-2eb8-4fc5-8d17-9f7c34a3a7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:31.297076 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34973b4-2eb8-4fc5-8d17-9f7c34a3a7eb None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:31.297353 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34973b4-2eb8-4fc5-8d17-9f7c34a3a7eb None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:31.297622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34973b4-2eb8-4fc5-8d17-9f7c34a3a7eb None admin] PATH_INFO: `/v3/groups/12041efd3a9541858608f9652a730041` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:31.298762 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34973b4-2eb8-4fc5-8d17-9f7c34a3a7eb None admin] RBAC: Authorizing `identity:get_group(group_id=12041efd3a9541858608f9652a730041)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:31.300266 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34973b4-2eb8-4fc5-8d17-9f7c34a3a7eb None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:31.302117 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 162/331] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Oct 22 20:31:31 2022] GET /identity/v3/groups/12041efd3a9541858608f9652a730041 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:31.307706 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34973b4-2eb8-4fc5-8d17-9f7c34a3a7eb None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:31.383074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 170/332] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:31.389445 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fb178-a546-41e4-929a-022b36bf9996 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:31.421499 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34973b4-2eb8-4fc5-8d17-9f7c34a3a7eb None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:31.450263 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:31.457325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2ad7b-f83c-48c2-ae2d-dac884c8b0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:31.457932 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2ad7b-f83c-48c2-ae2d-dac884c8b0d5 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:31.458207 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2ad7b-f83c-48c2-ae2d-dac884c8b0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:31.458527 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff2ad7b-f83c-48c2-ae2d-dac884c8b0d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:31.459303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2ad7b-f83c-48c2-ae2d-dac884c8b0d5 None admin] RBAC: Adding query filter params (group.id=12041efd3a9541858608f9652a730041, role.id=717e33c007ba49a5af257abafa205f0f, scope.project.id=eadc8205943c46cfaec67ba17ede1850) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:31.459631 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2ad7b-f83c-48c2-ae2d-dac884c8b0d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:31.461225 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff2ad7b-f83c-48c2-ae2d-dac884c8b0d5 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:31.467547 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 163/333] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Oct 22 20:31:31 2022] GET /identity/v3/role_assignments?group.id=12041efd3a9541858608f9652a730041&scope.project.id=eadc8205943c46cfaec67ba17ede1850&role.id=717e33c007ba49a5af257abafa205f0f => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:31.476448 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:31.499349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60fb178-a546-41e4-929a-022b36bf9996 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:31.538615 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f339d7-9eb2-4dbc-b177-e96d8dbb35b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:31.539355 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f339d7-9eb2-4dbc-b177-e96d8dbb35b9 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:31.539545 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f339d7-9eb2-4dbc-b177-e96d8dbb35b9 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:31.539809 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f339d7-9eb2-4dbc-b177-e96d8dbb35b9 None admin] PATH_INFO: `/v3/projects/9729266775c4452a92f26be4932200ad` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:31.541132 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f339d7-9eb2-4dbc-b177-e96d8dbb35b9 None admin] RBAC: Authorizing `identity:get_project(project_id=9729266775c4452a92f26be4932200ad)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:31.542613 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f339d7-9eb2-4dbc-b177-e96d8dbb35b9 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:31.544381 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 171/334] 10.222.0.39 () {56 vars in 1186 bytes} [Sat Oct 22 20:31:31 2022] GET /identity/v3/projects/9729266775c4452a92f26be4932200ad => generated 344 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:31.550789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2ad7b-f83c-48c2-ae2d-dac884c8b0d5 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:31.666132 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff2ad7b-f83c-48c2-ae2d-dac884c8b0d5 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:31.708406 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad51d473-7af2-4f6c-a4fc-b9a97b8d0c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:31.709083 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51d473-7af2-4f6c-a4fc-b9a97b8d0c33 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:31.709357 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51d473-7af2-4f6c-a4fc-b9a97b8d0c33 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:31.709622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad51d473-7af2-4f6c-a4fc-b9a97b8d0c33 None admin] PATH_INFO: `/v3/groups/c54a424c95d54589973c2a5798911344` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:31.710813 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51d473-7af2-4f6c-a4fc-b9a97b8d0c33 None admin] RBAC: Authorizing `identity:get_group(group_id=c54a424c95d54589973c2a5798911344)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:31.712312 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad51d473-7af2-4f6c-a4fc-b9a97b8d0c33 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:31.713868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 164/335] 10.222.0.39 () {56 vars in 1180 bytes} [Sat Oct 22 20:31:31 2022] GET /identity/v3/groups/c54a424c95d54589973c2a5798911344 => generated 229 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:31.720312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f339d7-9eb2-4dbc-b177-e96d8dbb35b9 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:31.824839 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f339d7-9eb2-4dbc-b177-e96d8dbb35b9 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:31.858072 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb175c-9fde-476d-b174-0dafae975def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:31.858666 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb175c-9fde-476d-b174-0dafae975def None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:31.858936 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb175c-9fde-476d-b174-0dafae975def None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:31.859207 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb175c-9fde-476d-b174-0dafae975def None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:31.859948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb175c-9fde-476d-b174-0dafae975def None admin] RBAC: Adding query filter params (group.id=c54a424c95d54589973c2a5798911344, role.id=7fb86065b4ef4b98873a590a9c66cfdc, scope.project.id=9729266775c4452a92f26be4932200ad) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:31.860245 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb175c-9fde-476d-b174-0dafae975def None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:31.861684 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb175c-9fde-476d-b174-0dafae975def None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:31.867588 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 172/336] 10.222.0.39 () {56 vars in 1376 bytes} [Sat Oct 22 20:31:31 2022] GET /identity/v3/role_assignments?group.id=c54a424c95d54589973c2a5798911344&scope.project.id=9729266775c4452a92f26be4932200ad&role.id=7fb86065b4ef4b98873a590a9c66cfdc => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:34.573697 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73e093-a35c-4433-b84f-6a6ff78cda32 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:34.574230 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73e093-a35c-4433-b84f-6a6ff78cda32 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:34.574230 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f73e093-a35c-4433-b84f-6a6ff78cda32 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:34.575575 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 165/337] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:34.580908 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80903-9cb4-452d-8f15-48d43f4d1426 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:34.581296 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80903-9cb4-452d-8f15-48d43f4d1426 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:34.581475 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f80903-9cb4-452d-8f15-48d43f4d1426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:34.599809 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-45f80903-9cb4-452d-8f15-48d43f4d1426 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:34.600979 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-45f80903-9cb4-452d-8f15-48d43f4d1426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:34.609129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:34.675172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 173/338] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:34.772585 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d18cde-4c6a-41d3-b58f-508e2385aa7a None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:34.772925 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d18cde-4c6a-41d3-b58f-508e2385aa7a None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:34.773112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d18cde-4c6a-41d3-b58f-508e2385aa7a None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:34.774867 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 166/339] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:34.780951 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ed98-f3c5-4776-8af1-b54399002822 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:34.781291 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ed98-f3c5-4776-8af1-b54399002822 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:34.781494 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53ed98-f3c5-4776-8af1-b54399002822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:34.801119 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-6b53ed98-f3c5-4776-8af1-b54399002822 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:34.802319 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-6b53ed98-f3c5-4776-8af1-b54399002822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:34.879364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 174/340] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:34.888112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1564a83-7b42-4d9e-aff3-0c3a69feb3ce None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:34.888390 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1564a83-7b42-4d9e-aff3-0c3a69feb3ce None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:34.888656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1564a83-7b42-4d9e-aff3-0c3a69feb3ce None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:34.889986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 167/341] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:34.895106 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8be2-1c93-46dc-beee-d1f7395e006f None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:34.895435 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8be2-1c93-46dc-beee-d1f7395e006f None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:34.895704 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754b8be2-1c93-46dc-beee-d1f7395e006f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:34.917689 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-754b8be2-1c93-46dc-beee-d1f7395e006f None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:34.919169 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-754b8be2-1c93-46dc-beee-d1f7395e006f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:34.985944 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 175/342] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:35.012576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1564a83-7b42-4d9e-aff3-0c3a69feb3ce None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.077818 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:35.122799 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1564a83-7b42-4d9e-aff3-0c3a69feb3ce None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:35.157599 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4970702-13c0-4fb6-9a8f-f38f1e73660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:35.158216 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4970702-13c0-4fb6-9a8f-f38f1e73660f None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.158485 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4970702-13c0-4fb6-9a8f-f38f1e73660f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.158747 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4970702-13c0-4fb6-9a8f-f38f1e73660f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.168856 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4970702-13c0-4fb6-9a8f-f38f1e73660f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:35.170401 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4970702-13c0-4fb6-9a8f-f38f1e73660f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-c4970702-13c0-4fb6-9a8f-f38f1e73660f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:35.186136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:35.187041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:35.187891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:35.187891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:35.187891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:35.187891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 168/343] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:35.194368 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b8be2-1c93-46dc-beee-d1f7395e006f None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.196943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:35.214804 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25d282-19ed-4aa6-9a95-e38366dc92e4 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.214804 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25d282-19ed-4aa6-9a95-e38366dc92e4 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.214804 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25d282-19ed-4aa6-9a95-e38366dc92e4 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.214804 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 169/344] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:31:35.220245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e0d73-e2e8-4927-857e-84ceb5e5b686 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.220517 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e0d73-e2e8-4927-857e-84ceb5e5b686 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.220775 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8e0d73-e2e8-4927-857e-84ceb5e5b686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.241324 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-fe8e0d73-e2e8-4927-857e-84ceb5e5b686 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:35.242409 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-fe8e0d73-e2e8-4927-857e-84ceb5e5b686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:35.311293 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 170/345] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:35.312230 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e0d73-e2e8-4927-857e-84ceb5e5b686 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.322872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754b8be2-1c93-46dc-beee-d1f7395e006f None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:35.360480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:35.361466 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055f4a-358d-4140-beae-1b74c879a495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:35.362060 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055f4a-358d-4140-beae-1b74c879a495 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.362335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055f4a-358d-4140-beae-1b74c879a495 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.362599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4055f4a-358d-4140-beae-1b74c879a495 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.363533 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4055f4a-358d-4140-beae-1b74c879a495 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:35.363860 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4055f4a-358d-4140-beae-1b74c879a495 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:35.365342 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4055f4a-358d-4140-beae-1b74c879a495 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:35.376924 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 176/346] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:35.377699 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055f4a-358d-4140-beae-1b74c879a495 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.429787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8e0d73-e2e8-4927-857e-84ceb5e5b686 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:35.442441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:35.466042 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43e567-0212-431d-9d2c-01041b035e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:35.466674 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43e567-0212-431d-9d2c-01041b035e76 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.466951 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43e567-0212-431d-9d2c-01041b035e76 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.467222 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e43e567-0212-431d-9d2c-01041b035e76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.478046 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43e567-0212-431d-9d2c-01041b035e76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:35.479838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e43e567-0212-431d-9d2c-01041b035e76 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:35.482586 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4055f4a-358d-4140-beae-1b74c879a495 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-5e43e567-0212-431d-9d2c-01041b035e76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:35.494471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:35.495541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:35.496386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:35.496386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:35.496386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:35.496386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 171/347] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:35.496386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43e567-0212-431d-9d2c-01041b035e76 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.522113 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b60cef-78c2-49a2-b3e4-aa5f88930227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:35.522765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60cef-78c2-49a2-b3e4-aa5f88930227 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.523043 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60cef-78c2-49a2-b3e4-aa5f88930227 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.523339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b60cef-78c2-49a2-b3e4-aa5f88930227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.533599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b60cef-78c2-49a2-b3e4-aa5f88930227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:35.535037 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b60cef-78c2-49a2-b3e4-aa5f88930227 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-e1b60cef-78c2-49a2-b3e4-aa5f88930227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:35.550180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:35.551085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:35.551947 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:35.551947 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:35.551947 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:35.551947 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 177/348] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:35.552153 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b60cef-78c2-49a2-b3e4-aa5f88930227 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.612649 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:35.619569 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e43e567-0212-431d-9d2c-01041b035e76 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:35.652382 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b60cef-78c2-49a2-b3e4-aa5f88930227 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:35.654813 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd54565-e5b8-4336-b9cf-743113f50504 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:35.655466 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd54565-e5b8-4336-b9cf-743113f50504 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.655747 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd54565-e5b8-4336-b9cf-743113f50504 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.656016 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd54565-e5b8-4336-b9cf-743113f50504 None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.656657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd54565-e5b8-4336-b9cf-743113f50504 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:35.658092 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd54565-e5b8-4336-b9cf-743113f50504 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:35.666271 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:35.679905 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 172/349] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:31:35 2022] POST /identity/v3/users => generated 246 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:31:35.681047 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd54565-e5b8-4336-b9cf-743113f50504 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.693750 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e92d07-b508-4b27-8a47-3a34cf51e8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:35.695841 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e92d07-b508-4b27-8a47-3a34cf51e8b8 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.696127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e92d07-b508-4b27-8a47-3a34cf51e8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.696399 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e92d07-b508-4b27-8a47-3a34cf51e8b8 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.697068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e92d07-b508-4b27-8a47-3a34cf51e8b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:35.697372 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e92d07-b508-4b27-8a47-3a34cf51e8b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:35.698878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e92d07-b508-4b27-8a47-3a34cf51e8b8 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:35.713726 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 178/350] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:35.714392 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e92d07-b508-4b27-8a47-3a34cf51e8b8 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.816770 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd54565-e5b8-4336-b9cf-743113f50504 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:35.829008 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e92d07-b508-4b27-8a47-3a34cf51e8b8 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:35.859674 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59760781-2a8b-48de-99b7-77dffb5f8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:35.860518 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760781-2a8b-48de-99b7-77dffb5f8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.860624 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760781-2a8b-48de-99b7-77dffb5f8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.860834 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59760781-2a8b-48de-99b7-77dffb5f8bb9 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.861480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59760781-2a8b-48de-99b7-77dffb5f8bb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:35.861780 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59760781-2a8b-48de-99b7-77dffb5f8bb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:35.863189 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59760781-2a8b-48de-99b7-77dffb5f8bb9 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:35.871845 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14377f-e11b-4d4f-b03e-5e8904886269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:35.872490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14377f-e11b-4d4f-b03e-5e8904886269 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:35.872763 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14377f-e11b-4d4f-b03e-5e8904886269 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:35.873030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e14377f-e11b-4d4f-b03e-5e8904886269 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:35.882368 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 173/351] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:35.884550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14377f-e11b-4d4f-b03e-5e8904886269 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:35.886046 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e14377f-e11b-4d4f-b03e-5e8904886269 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:35.887954 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59760781-2a8b-48de-99b7-77dffb5f8bb9 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-6e14377f-e11b-4d4f-b03e-5e8904886269 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:35.901629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:35.902619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:35.903566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:35.903566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:35.903566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:35.903566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 179/352] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:35.903566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14377f-e11b-4d4f-b03e-5e8904886269 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:35.908417 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:35.937328 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:36.001237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59760781-2a8b-48de-99b7-77dffb5f8bb9 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:36.016833 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e14377f-e11b-4d4f-b03e-5e8904886269 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:36.034711 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab876d-b190-4432-bec2-eeb3cd4a21fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:36.035337 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab876d-b190-4432-bec2-eeb3cd4a21fe None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:36.035610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab876d-b190-4432-bec2-eeb3cd4a21fe None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:36.035874 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab876d-b190-4432-bec2-eeb3cd4a21fe None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:36.036501 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab876d-b190-4432-bec2-eeb3cd4a21fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:36.038156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab876d-b190-4432-bec2-eeb3cd4a21fe None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:36.052022 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003894e-de6f-405c-8ca8-65bcdcbf022f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:36.052745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003894e-de6f-405c-8ca8-65bcdcbf022f None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:36.053087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003894e-de6f-405c-8ca8-65bcdcbf022f None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:36.053482 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9003894e-de6f-405c-8ca8-65bcdcbf022f None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:36.054097 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003894e-de6f-405c-8ca8-65bcdcbf022f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:36.055573 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9003894e-de6f-405c-8ca8-65bcdcbf022f None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:36.060813 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 174/353] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:31:35 2022] POST /identity/v3/users => generated 248 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:31:36.061769 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab876d-b190-4432-bec2-eeb3cd4a21fe None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:36.085526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 180/354] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:31:35 2022] POST /identity/v3/users => generated 248 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:31:36.164542 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:36.205259 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab876d-b190-4432-bec2-eeb3cd4a21fe None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:36.246052 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5b630e-7778-4cc7-9d02-f579bdcfa3aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:36.246714 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b630e-7778-4cc7-9d02-f579bdcfa3aa None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:36.246987 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b630e-7778-4cc7-9d02-f579bdcfa3aa None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:36.247250 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5b630e-7778-4cc7-9d02-f579bdcfa3aa None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:36.247932 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b630e-7778-4cc7-9d02-f579bdcfa3aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:36.248289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b630e-7778-4cc7-9d02-f579bdcfa3aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:36.249835 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5b630e-7778-4cc7-9d02-f579bdcfa3aa None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:36.264568 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 175/355] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:36.270140 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003894e-de6f-405c-8ca8-65bcdcbf022f None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:36.364373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:36.385916 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9003894e-de6f-405c-8ca8-65bcdcbf022f None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:36.428968 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdd2ff8-7d64-4383-965c-489348d88bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:36.429609 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd2ff8-7d64-4383-965c-489348d88bc5 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:36.429886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd2ff8-7d64-4383-965c-489348d88bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:36.430154 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdd2ff8-7d64-4383-965c-489348d88bc5 None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:36.430801 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd2ff8-7d64-4383-965c-489348d88bc5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:36.432310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdd2ff8-7d64-4383-965c-489348d88bc5 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:36.455380 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 181/356] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:31:36 2022] POST /identity/v3/users => generated 249 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:31:38.102359 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83addb74-ffd4-4150-864c-23ec029fef0c None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.102883 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83addb74-ffd4-4150-864c-23ec029fef0c None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.102883 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83addb74-ffd4-4150-864c-23ec029fef0c None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.104784 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 176/357] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:38.110152 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f36a4-df98-4f24-a3e3-6798c3b62a10 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.110565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f36a4-df98-4f24-a3e3-6798c3b62a10 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.110702 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f36a4-df98-4f24-a3e3-6798c3b62a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.128923 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-543f36a4-df98-4f24-a3e3-6798c3b62a10 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:38.130109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-543f36a4-df98-4f24-a3e3-6798c3b62a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:38.200111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 182/358] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:38.532777 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83addb74-ffd4-4150-864c-23ec029fef0c None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:38.619141 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc43e-63d6-4c42-8e14-576a014fdd0b None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.619450 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc43e-63d6-4c42-8e14-576a014fdd0b None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.619723 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066cc43e-63d6-4c42-8e14-576a014fdd0b None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.621070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 183/359] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:38.626551 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b6d5-e63c-4c18-ab46-e57bb5795ef5 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.626826 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b6d5-e63c-4c18-ab46-e57bb5795ef5 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.627092 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe02b6d5-e63c-4c18-ab46-e57bb5795ef5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.643439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83addb74-ffd4-4150-864c-23ec029fef0c None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:38.645390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-fe02b6d5-e63c-4c18-ab46-e57bb5795ef5 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:38.646547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-fe02b6d5-e63c-4c18-ab46-e57bb5795ef5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:38.675944 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:38.681211 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903df14f-b58e-46ad-94a8-32af03203379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:38.681831 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df14f-b58e-46ad-94a8-32af03203379 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.682113 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df14f-b58e-46ad-94a8-32af03203379 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.682366 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903df14f-b58e-46ad-94a8-32af03203379 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.692633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903df14f-b58e-46ad-94a8-32af03203379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-903df14f-b58e-46ad-94a8-32af03203379 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:38.697589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:38.698441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 177/360] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:38.700147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0b9aa-e53d-492b-acc5-89cfb34009f9 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.700843 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0b9aa-e53d-492b-acc5-89cfb34009f9 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.700843 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0b9aa-e53d-492b-acc5-89cfb34009f9 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.702395 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 178/361] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:38.707072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0b9aa-e53d-492b-acc5-89cfb34009f9 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:38.718086 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:38.730932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 184/362] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:38.730932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa891abd-f59e-470c-b9ea-1ef687d8fe66 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.730932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa891abd-f59e-470c-b9ea-1ef687d8fe66 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.730932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa891abd-f59e-470c-b9ea-1ef687d8fe66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.751053 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-fa891abd-f59e-470c-b9ea-1ef687d8fe66 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:38.752274 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-fa891abd-f59e-470c-b9ea-1ef687d8fe66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:38.824688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 185/363] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:38.836978 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0b9aa-e53d-492b-acc5-89cfb34009f9 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:38.868896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719959c-f03c-40b3-a409-c0288b4759e6 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.869202 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719959c-f03c-40b3-a409-c0288b4759e6 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.869443 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b719959c-f03c-40b3-a409-c0288b4759e6 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.870784 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 186/364] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:31:38.873917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e57ed-cdd5-4d21-af64-f485bb230fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:38.874768 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e57ed-cdd5-4d21-af64-f485bb230fd9 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.875222 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e57ed-cdd5-4d21-af64-f485bb230fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.875540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0e57ed-cdd5-4d21-af64-f485bb230fd9 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.876115 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa726c-75fa-456b-b78c-2120934bd290 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:38.876211 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e57ed-cdd5-4d21-af64-f485bb230fd9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:38.876396 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa726c-75fa-456b-b78c-2120934bd290 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:38.876494 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e57ed-cdd5-4d21-af64-f485bb230fd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:38.876662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78aa726c-75fa-456b-b78c-2120934bd290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:38.877803 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0e57ed-cdd5-4d21-af64-f485bb230fd9 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:38.886635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 179/365] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:31:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:38.892192 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e57ed-cdd5-4d21-af64-f485bb230fd9 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:38.900157 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-78aa726c-75fa-456b-b78c-2120934bd290 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:38.901986 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-78aa726c-75fa-456b-b78c-2120934bd290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:38.943930 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:38.987298 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 187/366] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:39.010219 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0e57ed-cdd5-4d21-af64-f485bb230fd9 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.044450 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42380c7e-6539-4f0b-9a36-2c8198ad89d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.045295 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42380c7e-6539-4f0b-9a36-2c8198ad89d6 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.045708 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42380c7e-6539-4f0b-9a36-2c8198ad89d6 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.046102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42380c7e-6539-4f0b-9a36-2c8198ad89d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.058020 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42380c7e-6539-4f0b-9a36-2c8198ad89d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:39.059746 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42380c7e-6539-4f0b-9a36-2c8198ad89d6 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:39.067468 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa726c-75fa-456b-b78c-2120934bd290 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-42380c7e-6539-4f0b-9a36-2c8198ad89d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:39.077635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:39.078734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:39.079900 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:39.079900 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:39.079900 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:39.081654 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 180/367] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:39.087302 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42380c7e-6539-4f0b-9a36-2c8198ad89d6 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.140340 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:39.187547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78aa726c-75fa-456b-b78c-2120934bd290 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.209649 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42380c7e-6539-4f0b-9a36-2c8198ad89d6 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.211236 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:39.223127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da06eef-7607-4f96-93ef-ef6e45b4bb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.223777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da06eef-7607-4f96-93ef-ef6e45b4bb70 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.224050 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da06eef-7607-4f96-93ef-ef6e45b4bb70 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.224312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da06eef-7607-4f96-93ef-ef6e45b4bb70 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.235113 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da06eef-7607-4f96-93ef-ef6e45b4bb70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-1da06eef-7607-4f96-93ef-ef6e45b4bb70 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:39.239872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:39.240794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:39.241547 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 188/368] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:39.246437 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da06eef-7607-4f96-93ef-ef6e45b4bb70 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.249943 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c980e-be10-4a68-bd6b-ca26df33b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.251339 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c980e-be10-4a68-bd6b-ca26df33b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.251631 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c980e-be10-4a68-bd6b-ca26df33b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.251895 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c980e-be10-4a68-bd6b-ca26df33b5d1 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.252540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c980e-be10-4a68-bd6b-ca26df33b5d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:39.252831 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c980e-be10-4a68-bd6b-ca26df33b5d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:39.254188 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c980e-be10-4a68-bd6b-ca26df33b5d1 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:39.267475 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 181/369] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:39.268659 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c980e-be10-4a68-bd6b-ca26df33b5d1 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.350502 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da06eef-7607-4f96-93ef-ef6e45b4bb70 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.365056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c980e-be10-4a68-bd6b-ca26df33b5d1 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.367697 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:39.385118 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc037398-13f9-4a96-a257-ee39cf5a7a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.385743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc037398-13f9-4a96-a257-ee39cf5a7a1e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.386012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc037398-13f9-4a96-a257-ee39cf5a7a1e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.386282 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc037398-13f9-4a96-a257-ee39cf5a7a1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.397008 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc037398-13f9-4a96-a257-ee39cf5a7a1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:39.399795 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c55ca-f086-435a-82ec-a69bcd1bb90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.400430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c55ca-f086-435a-82ec-a69bcd1bb90f None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.400748 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c55ca-f086-435a-82ec-a69bcd1bb90f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.401018 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c55ca-f086-435a-82ec-a69bcd1bb90f None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.401680 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c55ca-f086-435a-82ec-a69bcd1bb90f None admin] RBAC: Adding query filter params (name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-dc037398-13f9-4a96-a257-ee39cf5a7a1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:39.401774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:39.402570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:39.403379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:39.403950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c55ca-f086-435a-82ec-a69bcd1bb90f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:39.404015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 189/370] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:39.404077 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c55ca-f086-435a-82ec-a69bcd1bb90f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:39.404139 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc037398-13f9-4a96-a257-ee39cf5a7a1e None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.412273 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 182/371] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:39.413075 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c55ca-f086-435a-82ec-a69bcd1bb90f None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.437757 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:39.507127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc037398-13f9-4a96-a257-ee39cf5a7a1e None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.510428 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c55ca-f086-435a-82ec-a69bcd1bb90f None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.539906 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7d5dc-c12c-4cf5-bef0-a91708bd7ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.540531 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d5dc-c12c-4cf5-bef0-a91708bd7ffb None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.540796 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d5dc-c12c-4cf5-bef0-a91708bd7ffb None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.541063 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7d5dc-c12c-4cf5-bef0-a91708bd7ffb None admin] PATH_INFO: `/v3/users/nova` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.542012 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787d88a-a145-4909-a104-1c78615b5aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.542622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787d88a-a145-4909-a104-1c78615b5aa6 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.542899 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787d88a-a145-4909-a104-1c78615b5aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.543161 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787d88a-a145-4909-a104-1c78615b5aa6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.548152 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7d5dc-c12c-4cf5-bef0-a91708bd7ffb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:39.549588 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7d5dc-c12c-4cf5-bef0-a91708bd7ffb None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:39.552898 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787d88a-a145-4909-a104-1c78615b5aa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-8787d88a-a145-4909-a104-1c78615b5aa6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:39.558004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:39.558859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:39.559695 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 183/372] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:39.560342 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787d88a-a145-4909-a104-1c78615b5aa6 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-1ae7d5dc-c12c-4cf5-bef0-a91708bd7ffb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:39.562012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:39.562828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 190/373] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:39.564899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7d5dc-c12c-4cf5-bef0-a91708bd7ffb None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.604076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:39.645610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:39.662720 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787d88a-a145-4909-a104-1c78615b5aa6 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.662849 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7d5dc-c12c-4cf5-bef0-a91708bd7ffb None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.696091 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597af7a5-16ee-49b0-9a7d-6345014a4633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.696251 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9de79e-0337-486f-ba31-18403c655a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.696635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af7a5-16ee-49b0-9a7d-6345014a4633 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.696756 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9de79e-0337-486f-ba31-18403c655a1e None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.696905 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af7a5-16ee-49b0-9a7d-6345014a4633 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.697030 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9de79e-0337-486f-ba31-18403c655a1e None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.697166 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597af7a5-16ee-49b0-9a7d-6345014a4633 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.697297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9de79e-0337-486f-ba31-18403c655a1e None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.697948 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9de79e-0337-486f-ba31-18403c655a1e None admin] RBAC: Adding query filter params (name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:39.698244 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9de79e-0337-486f-ba31-18403c655a1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:39.699700 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9de79e-0337-486f-ba31-18403c655a1e None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:39.706844 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597af7a5-16ee-49b0-9a7d-6345014a4633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:39.707666 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 184/374] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:39.708293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597af7a5-16ee-49b0-9a7d-6345014a4633 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:39.708414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9de79e-0337-486f-ba31-18403c655a1e None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-597af7a5-16ee-49b0-9a7d-6345014a4633 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:39.728272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:39.729668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:39.730635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:39.730635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:39.730635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:39.730635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 191/375] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:39.730635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597af7a5-16ee-49b0-9a7d-6345014a4633 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.812057 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9de79e-0337-486f-ba31-18403c655a1e None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.820242 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:39.830487 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597af7a5-16ee-49b0-9a7d-6345014a4633 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.845687 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7777e5-c5be-4fe7-87a3-a3da5367b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.846272 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7777e5-c5be-4fe7-87a3-a3da5367b268 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.846544 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7777e5-c5be-4fe7-87a3-a3da5367b268 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.846807 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7777e5-c5be-4fe7-87a3-a3da5367b268 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.847509 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7777e5-c5be-4fe7-87a3-a3da5367b268 None admin] RBAC: Adding query filter params (name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:39.847798 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7777e5-c5be-4fe7-87a3-a3da5367b268 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:39.849164 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7777e5-c5be-4fe7-87a3-a3da5367b268 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:39.857286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 185/376] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:39.858056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7777e5-c5be-4fe7-87a3-a3da5367b268 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.866446 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d0404-94bd-4dbc-aa18-c5609e19f271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.867484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d0404-94bd-4dbc-aa18-c5609e19f271 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.867754 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d0404-94bd-4dbc-aa18-c5609e19f271 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.868022 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699d0404-94bd-4dbc-aa18-c5609e19f271 None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.868629 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:39.868781 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d0404-94bd-4dbc-aa18-c5609e19f271 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:39.869094 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d0404-94bd-4dbc-aa18-c5609e19f271 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:39.870629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699d0404-94bd-4dbc-aa18-c5609e19f271 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:39.906101 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 192/377] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:39.906730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d0404-94bd-4dbc-aa18-c5609e19f271 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:39.956659 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7777e5-c5be-4fe7-87a3-a3da5367b268 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:39.991125 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb163-3822-4a44-b895-9371c191ba58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:39.991763 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb163-3822-4a44-b895-9371c191ba58 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:39.992040 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb163-3822-4a44-b895-9371c191ba58 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:39.992307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282eb163-3822-4a44-b895-9371c191ba58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:39.999819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699d0404-94bd-4dbc-aa18-c5609e19f271 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.002753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eb163-3822-4a44-b895-9371c191ba58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.004353 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282eb163-3822-4a44-b895-9371c191ba58 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-282eb163-3822-4a44-b895-9371c191ba58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:40.018196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:40.019120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:40.019966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:40.019966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:40.019966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:40.019966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 186/378] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:40.020172 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb163-3822-4a44-b895-9371c191ba58 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.036313 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec79ad-a870-49c7-97c0-0645cd711bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.036968 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec79ad-a870-49c7-97c0-0645cd711bd2 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.037250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec79ad-a870-49c7-97c0-0645cd711bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.037521 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec79ad-a870-49c7-97c0-0645cd711bd2 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.038166 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec79ad-a870-49c7-97c0-0645cd711bd2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:40.038468 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec79ad-a870-49c7-97c0-0645cd711bd2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.039943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec79ad-a870-49c7-97c0-0645cd711bd2 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.051097 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 193/379] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:40.051901 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec79ad-a870-49c7-97c0-0645cd711bd2 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.064059 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.078966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.120604 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282eb163-3822-4a44-b895-9371c191ba58 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.152697 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec79ad-a870-49c7-97c0-0645cd711bd2 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.154084 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c183568-abbb-478a-8480-7459802e2e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.154698 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c183568-abbb-478a-8480-7459802e2e15 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.154973 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c183568-abbb-478a-8480-7459802e2e15 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.155235 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c183568-abbb-478a-8480-7459802e2e15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.165674 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c183568-abbb-478a-8480-7459802e2e15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.167166 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c183568-abbb-478a-8480-7459802e2e15 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-0c183568-abbb-478a-8480-7459802e2e15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:40.181190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:40.182108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:40.182935 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:40.182935 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:40.182935 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:40.182935 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 187/380] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:40.183160 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c183568-abbb-478a-8480-7459802e2e15 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.189014 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08fdb1-cd33-4fbb-97b1-a031ba8c6fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.189630 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08fdb1-cd33-4fbb-97b1-a031ba8c6fff None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.189919 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08fdb1-cd33-4fbb-97b1-a031ba8c6fff None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.190183 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a08fdb1-cd33-4fbb-97b1-a031ba8c6fff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.202341 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08fdb1-cd33-4fbb-97b1-a031ba8c6fff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.204021 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a08fdb1-cd33-4fbb-97b1-a031ba8c6fff None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-1a08fdb1-cd33-4fbb-97b1-a031ba8c6fff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:40.218040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:40.218898 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:40.219745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:40.219745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:40.219745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:40.219745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 194/381] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:40.219968 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08fdb1-cd33-4fbb-97b1-a031ba8c6fff None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.282559 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.285461 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c183568-abbb-478a-8480-7459802e2e15 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.298112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.319203 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545229dd-2b47-4440-87e3-dff28bfcf4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.319819 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545229dd-2b47-4440-87e3-dff28bfcf4c0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.320093 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545229dd-2b47-4440-87e3-dff28bfcf4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.320357 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545229dd-2b47-4440-87e3-dff28bfcf4c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.320986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545229dd-2b47-4440-87e3-dff28bfcf4c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:40.321285 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545229dd-2b47-4440-87e3-dff28bfcf4c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.322244 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a08fdb1-cd33-4fbb-97b1-a031ba8c6fff None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.322648 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545229dd-2b47-4440-87e3-dff28bfcf4c0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.334404 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 188/382] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:40.335355 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545229dd-2b47-4440-87e3-dff28bfcf4c0 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.357394 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e4933-df33-4832-95db-4e84e1b3c1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.358013 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e4933-df33-4832-95db-4e84e1b3c1c9 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.358283 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e4933-df33-4832-95db-4e84e1b3c1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.358602 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427e4933-df33-4832-95db-4e84e1b3c1c9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.365430 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e4933-df33-4832-95db-4e84e1b3c1c9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.366865 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427e4933-df33-4832-95db-4e84e1b3c1c9 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-427e4933-df33-4832-95db-4e84e1b3c1c9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:40.377890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:40.378756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 195/383] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:40.379987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e4933-df33-4832-95db-4e84e1b3c1c9 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.436824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545229dd-2b47-4440-87e3-dff28bfcf4c0 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.470464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e445-67c8-4022-a53d-8d0df30b90c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.470983 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e445-67c8-4022-a53d-8d0df30b90c0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.471252 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e445-67c8-4022-a53d-8d0df30b90c0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.471600 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc19e445-67c8-4022-a53d-8d0df30b90c0 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.472173 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e445-67c8-4022-a53d-8d0df30b90c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:40.472473 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e445-67c8-4022-a53d-8d0df30b90c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.473847 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc19e445-67c8-4022-a53d-8d0df30b90c0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.481140 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427e4933-df33-4832-95db-4e84e1b3c1c9 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.485314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 189/384] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:40.486071 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e445-67c8-4022-a53d-8d0df30b90c0 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.503435 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.515728 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.517591 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762378b0-0aa7-4a3d-accc-aef6b33b8bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.518216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762378b0-0aa7-4a3d-accc-aef6b33b8bf9 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.518492 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762378b0-0aa7-4a3d-accc-aef6b33b8bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.518758 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762378b0-0aa7-4a3d-accc-aef6b33b8bf9 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.519429 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762378b0-0aa7-4a3d-accc-aef6b33b8bf9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:40.519727 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762378b0-0aa7-4a3d-accc-aef6b33b8bf9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.521091 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762378b0-0aa7-4a3d-accc-aef6b33b8bf9 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.532763 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 196/385] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:40.533453 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762378b0-0aa7-4a3d-accc-aef6b33b8bf9 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.583012 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc19e445-67c8-4022-a53d-8d0df30b90c0 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.618585 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f2432-9089-4c93-be8a-d7a7410574f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.619190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f2432-9089-4c93-be8a-d7a7410574f7 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.619487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f2432-9089-4c93-be8a-d7a7410574f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.619747 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3f2432-9089-4c93-be8a-d7a7410574f7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.627736 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f2432-9089-4c93-be8a-d7a7410574f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.629194 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3f2432-9089-4c93-be8a-d7a7410574f7 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.630808 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762378b0-0aa7-4a3d-accc-aef6b33b8bf9 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-6e3f2432-9089-4c93-be8a-d7a7410574f7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:40.641885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:40.642956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:40.644146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 190/386] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:40.644814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f2432-9089-4c93-be8a-d7a7410574f7 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.668830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc18b2-be6c-498b-958a-fb61cd921876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.669435 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc18b2-be6c-498b-958a-fb61cd921876 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.669705 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc18b2-be6c-498b-958a-fb61cd921876 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.669964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bc18b2-be6c-498b-958a-fb61cd921876 None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.670681 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc18b2-be6c-498b-958a-fb61cd921876 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:40.670980 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc18b2-be6c-498b-958a-fb61cd921876 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.672432 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93bc18b2-be6c-498b-958a-fb61cd921876 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.689092 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 197/387] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:40.689881 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc18b2-be6c-498b-958a-fb61cd921876 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.731658 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.732910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.741987 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3f2432-9089-4c93-be8a-d7a7410574f7 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.774157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d219a-123e-48ab-acd0-38aab40640d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.774770 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d219a-123e-48ab-acd0-38aab40640d0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.775084 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d219a-123e-48ab-acd0-38aab40640d0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.775375 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d219a-123e-48ab-acd0-38aab40640d0 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.782777 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d219a-123e-48ab-acd0-38aab40640d0 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.784277 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d219a-123e-48ab-acd0-38aab40640d0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.791473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93bc18b2-be6c-498b-958a-fb61cd921876 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-297d219a-123e-48ab-acd0-38aab40640d0 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:40.795062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:40.796158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 191/388] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:40.802094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d219a-123e-48ab-acd0-38aab40640d0 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.825721 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3f48-4444-4196-96a5-d188bad61e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.826348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3f48-4444-4196-96a5-d188bad61e57 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.826623 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3f48-4444-4196-96a5-d188bad61e57 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.826894 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab3f48-4444-4196-96a5-d188bad61e57 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.833379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab3f48-4444-4196-96a5-d188bad61e57 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.834869 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab3f48-4444-4196-96a5-d188bad61e57 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-e3ab3f48-4444-4196-96a5-d188bad61e57 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:40.846601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:40.847670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 198/389] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:40.853627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3f48-4444-4196-96a5-d188bad61e57 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.894471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d219a-123e-48ab-acd0-38aab40640d0 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.929336 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b631c-66d5-4c37-ac6f-80e1e720c707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.929929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b631c-66d5-4c37-ac6f-80e1e720c707 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.930203 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b631c-66d5-4c37-ac6f-80e1e720c707 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.930475 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281b631c-66d5-4c37-ac6f-80e1e720c707 None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.931201 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b631c-66d5-4c37-ac6f-80e1e720c707 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:40.931530 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b631c-66d5-4c37-ac6f-80e1e720c707 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.932966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281b631c-66d5-4c37-ac6f-80e1e720c707 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:40.947668 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.951640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab3f48-4444-4196-96a5-d188bad61e57 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:40.968677 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 192/390] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:40.969594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b631c-66d5-4c37-ac6f-80e1e720c707 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:40.985381 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:40.986166 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fd873-c4e5-46f0-b9f6-08067fdecc6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:40.986747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fd873-c4e5-46f0-b9f6-08067fdecc6e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:40.987026 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fd873-c4e5-46f0-b9f6-08067fdecc6e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:40.987319 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fd873-c4e5-46f0-b9f6-08067fdecc6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:40.997258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fd873-c4e5-46f0-b9f6-08067fdecc6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:40.998710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3fd873-c4e5-46f0-b9f6-08067fdecc6e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-0d3fd873-c4e5-46f0-b9f6-08067fdecc6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:41.012852 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:41.013903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:41.015081 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:41.015081 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:41.015081 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:41.015081 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 199/391] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:41.015081 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fd873-c4e5-46f0-b9f6-08067fdecc6e None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.076371 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281b631c-66d5-4c37-ac6f-80e1e720c707 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.110575 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f19eb-8145-4391-b206-f22ac7b519cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.111170 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f19eb-8145-4391-b206-f22ac7b519cf None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.111476 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f19eb-8145-4391-b206-f22ac7b519cf None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.111692 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3fd873-c4e5-46f0-b9f6-08067fdecc6e None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.111786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408f19eb-8145-4391-b206-f22ac7b519cf None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.112452 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f19eb-8145-4391-b206-f22ac7b519cf None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:41.112749 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f19eb-8145-4391-b206-f22ac7b519cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.114235 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408f19eb-8145-4391-b206-f22ac7b519cf None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.130935 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 193/392] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Oct 22 20:31:40 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:41.131754 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f19eb-8145-4391-b206-f22ac7b519cf None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.143913 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8bddd-48e1-483d-a05a-892b8bff46f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.144518 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8bddd-48e1-483d-a05a-892b8bff46f8 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.144818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8bddd-48e1-483d-a05a-892b8bff46f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.145086 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e8bddd-48e1-483d-a05a-892b8bff46f8 None admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.145770 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8bddd-48e1-483d-a05a-892b8bff46f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:41.146072 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8bddd-48e1-483d-a05a-892b8bff46f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.147554 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e8bddd-48e1-483d-a05a-892b8bff46f8 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.164769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 200/393] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:41.165619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8bddd-48e1-483d-a05a-892b8bff46f8 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.177433 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:41.200503 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:41.233364 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408f19eb-8145-4391-b206-f22ac7b519cf None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.265462 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e8bddd-48e1-483d-a05a-892b8bff46f8 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.266813 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7528a1-66ef-4dca-8053-1df09a3722bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.267429 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7528a1-66ef-4dca-8053-1df09a3722bf None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.267718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7528a1-66ef-4dca-8053-1df09a3722bf None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.267974 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7528a1-66ef-4dca-8053-1df09a3722bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.278119 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7528a1-66ef-4dca-8053-1df09a3722bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.279600 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7528a1-66ef-4dca-8053-1df09a3722bf None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-be7528a1-66ef-4dca-8053-1df09a3722bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:41.294315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:41.295863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:41.296781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:41.296781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:41.296781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:41.296781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 194/394] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:41.296781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7528a1-66ef-4dca-8053-1df09a3722bf None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.302209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1f278-4c8e-44d0-b926-92ed6a9b1fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.302860 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1f278-4c8e-44d0-b926-92ed6a9b1fc0 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.303136 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1f278-4c8e-44d0-b926-92ed6a9b1fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.303440 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd1f278-4c8e-44d0-b926-92ed6a9b1fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.304084 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1f278-4c8e-44d0-b926-92ed6a9b1fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:41.304383 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1f278-4c8e-44d0-b926-92ed6a9b1fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.305795 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd1f278-4c8e-44d0-b926-92ed6a9b1fc0 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.317676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 201/395] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:41.318258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1f278-4c8e-44d0-b926-92ed6a9b1fc0 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.385897 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:41.401118 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7528a1-66ef-4dca-8053-1df09a3722bf None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.418936 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd1f278-4c8e-44d0-b926-92ed6a9b1fc0 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.421568 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:41.435655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c336253-16ec-48f7-bdd6-930b4a8e4344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.436277 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c336253-16ec-48f7-bdd6-930b4a8e4344 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.436552 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c336253-16ec-48f7-bdd6-930b4a8e4344 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.436814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c336253-16ec-48f7-bdd6-930b4a8e4344 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.446971 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c336253-16ec-48f7-bdd6-930b4a8e4344 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.448479 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c336253-16ec-48f7-bdd6-930b4a8e4344 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.451929 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fcfaf-8008-4195-88bc-0b5d5a95c35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.452586 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fcfaf-8008-4195-88bc-0b5d5a95c35e None admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.452861 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fcfaf-8008-4195-88bc-0b5d5a95c35e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.453135 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fcfaf-8008-4195-88bc-0b5d5a95c35e None admin] PATH_INFO: `/v3/projects/994d024676c1425fa15492ab23e267fd/users/a3b1e73612ed4e4c83784e77194d20e1/roles/9f6b3138dda04fc884ae8e76a78e2865` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-2c336253-16ec-48f7-bdd6-930b4a8e4344 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:41.462732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:41.463926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:41.465309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:41.465309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:41.465309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:41.465309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 195/396] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:41.465309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c336253-16ec-48f7-bdd6-930b4a8e4344 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.473361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fcfaf-8008-4195-88bc-0b5d5a95c35e None admin] RBAC: Authorizing `identity:create_grant(project_id=994d024676c1425fa15492ab23e267fd, user_id=a3b1e73612ed4e4c83784e77194d20e1, role_id=9f6b3138dda04fc884ae8e76a78e2865)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.474961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fcfaf-8008-4195-88bc-0b5d5a95c35e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.489495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 202/397] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:31:41 2022] PUT /identity/v3/projects/994d024676c1425fa15492ab23e267fd/users/a3b1e73612ed4e4c83784e77194d20e1/roles/9f6b3138dda04fc884ae8e76a78e2865 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:31:41.490377 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fcfaf-8008-4195-88bc-0b5d5a95c35e None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.585582 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c336253-16ec-48f7-bdd6-930b4a8e4344 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.603207 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fcfaf-8008-4195-88bc-0b5d5a95c35e None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.623793 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2d546-f467-4c1b-8ba9-70aa536e8eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.624597 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2d546-f467-4c1b-8ba9-70aa536e8eb1 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.624964 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2d546-f467-4c1b-8ba9-70aa536e8eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.625327 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f2d546-f467-4c1b-8ba9-70aa536e8eb1 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.626128 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2d546-f467-4c1b-8ba9-70aa536e8eb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:41.626515 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:41.626625 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2d546-f467-4c1b-8ba9-70aa536e8eb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.628162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f2d546-f467-4c1b-8ba9-70aa536e8eb1 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.642268 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 196/398] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:41.643525 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2d546-f467-4c1b-8ba9-70aa536e8eb1 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.649633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9c36e-ea2a-4fb4-866c-e9036e292881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.650282 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c36e-ea2a-4fb4-866c-e9036e292881 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.650561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c36e-ea2a-4fb4-866c-e9036e292881 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.650830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9c36e-ea2a-4fb4-866c-e9036e292881 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.658530 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9c36e-ea2a-4fb4-866c-e9036e292881 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.660051 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9c36e-ea2a-4fb4-866c-e9036e292881 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-f5e9c36e-ea2a-4fb4-866c-e9036e292881 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:41.672257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:41.673330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 203/399] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:41.674252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9c36e-ea2a-4fb4-866c-e9036e292881 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.684835 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:41.761007 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f2d546-f467-4c1b-8ba9-70aa536e8eb1 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.788238 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9c36e-ea2a-4fb4-866c-e9036e292881 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.794463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e12eb4-c4fd-41c6-ad2a-9685d7d7e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.795240 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e12eb4-c4fd-41c6-ad2a-9685d7d7e29b None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.795768 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e12eb4-c4fd-41c6-ad2a-9685d7d7e29b None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.796288 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e12eb4-c4fd-41c6-ad2a-9685d7d7e29b None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.796938 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e12eb4-c4fd-41c6-ad2a-9685d7d7e29b None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:41.797237 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e12eb4-c4fd-41c6-ad2a-9685d7d7e29b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.798716 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e12eb4-c4fd-41c6-ad2a-9685d7d7e29b None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.812343 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 197/400] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:41.813174 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e12eb4-c4fd-41c6-ad2a-9685d7d7e29b None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.829230 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4313718-a7e7-4921-a3e2-3820d3a10317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.829858 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313718-a7e7-4921-a3e2-3820d3a10317 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.830128 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313718-a7e7-4921-a3e2-3820d3a10317 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.830396 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4313718-a7e7-4921-a3e2-3820d3a10317 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.837011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4313718-a7e7-4921-a3e2-3820d3a10317 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.838441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4313718-a7e7-4921-a3e2-3820d3a10317 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-c4313718-a7e7-4921-a3e2-3820d3a10317 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:41.849747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:41.850600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 204/401] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:41.852110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4313718-a7e7-4921-a3e2-3820d3a10317 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.893735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:41.914681 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:41.924651 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e12eb4-c4fd-41c6-ad2a-9685d7d7e29b None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.954808 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4313718-a7e7-4921-a3e2-3820d3a10317 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:41.959572 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23041b-141d-4199-939f-7bd9f8752ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.960176 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23041b-141d-4199-939f-7bd9f8752ebe None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.960456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23041b-141d-4199-939f-7bd9f8752ebe None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.960724 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23041b-141d-4199-939f-7bd9f8752ebe None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:41.961403 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23041b-141d-4199-939f-7bd9f8752ebe None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:41.961701 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23041b-141d-4199-939f-7bd9f8752ebe None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:41.963248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f23041b-141d-4199-939f-7bd9f8752ebe None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:41.982957 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 198/402] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:41.983950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23041b-141d-4199-939f-7bd9f8752ebe None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:41.993451 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601659d-1713-41cb-bd0d-697124ac32f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:41.994082 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601659d-1713-41cb-bd0d-697124ac32f3 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:41.994358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601659d-1713-41cb-bd0d-697124ac32f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:41.994629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601659d-1713-41cb-bd0d-697124ac32f3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:42.001948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601659d-1713-41cb-bd0d-697124ac32f3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:42.003419 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601659d-1713-41cb-bd0d-697124ac32f3 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-7601659d-1713-41cb-bd0d-697124ac32f3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:42.014678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:42.015546 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:42.016373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:42.016373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:42.016373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:42.016373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:42.016373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:42.016373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:42.016373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:42.016373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:42.016373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 205/403] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:42.017631 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601659d-1713-41cb-bd0d-697124ac32f3 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:42.096393 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f23041b-141d-4199-939f-7bd9f8752ebe None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:42.123415 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:42.126628 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601659d-1713-41cb-bd0d-697124ac32f3 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:42.132878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3b5cb-4ace-4d92-8c78-19cecdd35778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:42.133488 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3b5cb-4ace-4d92-8c78-19cecdd35778 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:42.133764 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3b5cb-4ace-4d92-8c78-19cecdd35778 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:42.134025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c3b5cb-4ace-4d92-8c78-19cecdd35778 None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:42.135134 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3b5cb-4ace-4d92-8c78-19cecdd35778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:42.135469 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3b5cb-4ace-4d92-8c78-19cecdd35778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:42.137313 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c3b5cb-4ace-4d92-8c78-19cecdd35778 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:42.150159 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 199/404] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:42.151161 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3b5cb-4ace-4d92-8c78-19cecdd35778 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:42.166505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb469e12-d69f-4446-a5d4-cde12c2ca62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:42.167154 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb469e12-d69f-4446-a5d4-cde12c2ca62c None admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:42.167454 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb469e12-d69f-4446-a5d4-cde12c2ca62c None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:42.167719 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb469e12-d69f-4446-a5d4-cde12c2ca62c None admin] PATH_INFO: `/v3/projects/994d024676c1425fa15492ab23e267fd/users/c0efaeef0d724cc69ce9daa0f70856d8/roles/9f6b3138dda04fc884ae8e76a78e2865` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:42.168619 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:42.183294 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb469e12-d69f-4446-a5d4-cde12c2ca62c None admin] RBAC: Authorizing `identity:create_grant(project_id=994d024676c1425fa15492ab23e267fd, user_id=c0efaeef0d724cc69ce9daa0f70856d8, role_id=9f6b3138dda04fc884ae8e76a78e2865)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:42.185030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb469e12-d69f-4446-a5d4-cde12c2ca62c None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:42.198311 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 206/405] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:31:42 2022] PUT /identity/v3/projects/994d024676c1425fa15492ab23e267fd/users/c0efaeef0d724cc69ce9daa0f70856d8/roles/9f6b3138dda04fc884ae8e76a78e2865 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:31:42.199085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb469e12-d69f-4446-a5d4-cde12c2ca62c None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:42.280870 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c3b5cb-4ace-4d92-8c78-19cecdd35778 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:42.320574 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce90d3a-8a01-41da-885e-15bfb3f6b914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:42.321885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce90d3a-8a01-41da-885e-15bfb3f6b914 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:42.322302 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce90d3a-8a01-41da-885e-15bfb3f6b914 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:42.322742 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce90d3a-8a01-41da-885e-15bfb3f6b914 None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:42.323616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce90d3a-8a01-41da-885e-15bfb3f6b914 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:42.324147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce90d3a-8a01-41da-885e-15bfb3f6b914 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:42.325677 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce90d3a-8a01-41da-885e-15bfb3f6b914 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:42.338160 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb469e12-d69f-4446-a5d4-cde12c2ca62c None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:42.343323 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 200/406] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:42.346487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce90d3a-8a01-41da-885e-15bfb3f6b914 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:42.387548 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1f1679-fa73-4f6a-ab62-aea8f1703b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:42.388232 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1679-fa73-4f6a-ab62-aea8f1703b84 None admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:42.388507 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1679-fa73-4f6a-ab62-aea8f1703b84 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:42.388799 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1f1679-fa73-4f6a-ab62-aea8f1703b84 None admin] PATH_INFO: `/v3/projects/994d024676c1425fa15492ab23e267fd/users/54a843b5fd164017b662b4a3eafc8ac0/roles/9f6b3138dda04fc884ae8e76a78e2865` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:42.416434 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f1679-fa73-4f6a-ab62-aea8f1703b84 None admin] RBAC: Authorizing `identity:create_grant(project_id=994d024676c1425fa15492ab23e267fd, user_id=54a843b5fd164017b662b4a3eafc8ac0, role_id=9f6b3138dda04fc884ae8e76a78e2865)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:42.418928 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1f1679-fa73-4f6a-ab62-aea8f1703b84 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:42.433082 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:42.442427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 207/407] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:31:42 2022] PUT /identity/v3/projects/994d024676c1425fa15492ab23e267fd/users/54a843b5fd164017b662b4a3eafc8ac0/roles/9f6b3138dda04fc884ae8e76a78e2865 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:31:42.443295 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:42.478583 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce90d3a-8a01-41da-885e-15bfb3f6b914 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:42.525419 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d535034f-7e96-41e9-ae11-7ff81cc01d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:42.526095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535034f-7e96-41e9-ae11-7ff81cc01d5f None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:42.526369 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535034f-7e96-41e9-ae11-7ff81cc01d5f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:42.526633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d535034f-7e96-41e9-ae11-7ff81cc01d5f None admin] PATH_INFO: `/v3/projects/994d024676c1425fa15492ab23e267fd/users/7f526e9ac6094156aa57f280c4de4f29/roles/9f6b3138dda04fc884ae8e76a78e2865` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:42.544215 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535034f-7e96-41e9-ae11-7ff81cc01d5f None admin] RBAC: Authorizing `identity:create_grant(project_id=994d024676c1425fa15492ab23e267fd, user_id=7f526e9ac6094156aa57f280c4de4f29, role_id=9f6b3138dda04fc884ae8e76a78e2865)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:42.545712 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d535034f-7e96-41e9-ae11-7ff81cc01d5f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:42.562735 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 201/408] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:31:42 2022] PUT /identity/v3/projects/994d024676c1425fa15492ab23e267fd/users/7f526e9ac6094156aa57f280c4de4f29/roles/9f6b3138dda04fc884ae8e76a78e2865 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:31:43.943837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29563-25c4-4f8d-825a-cae18678d40a None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:43.944369 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29563-25c4-4f8d-825a-cae18678d40a None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:43.944665 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e29563-25c4-4f8d-825a-cae18678d40a None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:43.946377 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 208/409] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:43.951871 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4eed1-9239-48d0-8467-86eeeaa99b5e None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:43.952285 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4eed1-9239-48d0-8467-86eeeaa99b5e None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:43.952593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e4eed1-9239-48d0-8467-86eeeaa99b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:43.971195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-a0e4eed1-9239-48d0-8467-86eeeaa99b5e None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:43.972557 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-a0e4eed1-9239-48d0-8467-86eeeaa99b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:44.041836 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 202/410] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:44.363100 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e29563-25c4-4f8d-825a-cae18678d40a None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:44.482767 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e29563-25c4-4f8d-825a-cae18678d40a None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:44.518425 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d4428-431e-4beb-b97f-dc85f0878f1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:44.519315 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d4428-431e-4beb-b97f-dc85f0878f1c None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:44.519749 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d4428-431e-4beb-b97f-dc85f0878f1c None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:44.520150 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496d4428-431e-4beb-b97f-dc85f0878f1c None admin] PATH_INFO: `/v3/roles/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:44.531892 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496d4428-431e-4beb-b97f-dc85f0878f1c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-496d4428-431e-4beb-b97f-dc85f0878f1c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:44.537087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:44.538227 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:44.539181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:44.541812 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 209/411] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:44.548761 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4eed1-9239-48d0-8467-86eeeaa99b5e None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:44.605159 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:44.662377 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e4eed1-9239-48d0-8467-86eeeaa99b5e None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:44.699804 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6801e8b-adc2-4347-b0a6-3ee04e6710d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:44.700411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6801e8b-adc2-4347-b0a6-3ee04e6710d9 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:44.700683 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6801e8b-adc2-4347-b0a6-3ee04e6710d9 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:44.700944 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6801e8b-adc2-4347-b0a6-3ee04e6710d9 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:44.701609 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6801e8b-adc2-4347-b0a6-3ee04e6710d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:44.701905 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6801e8b-adc2-4347-b0a6-3ee04e6710d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:44.708888 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6801e8b-adc2-4347-b0a6-3ee04e6710d9 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:44.712385 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 203/412] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:31:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:44.718052 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d4428-431e-4beb-b97f-dc85f0878f1c None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:44.783667 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:44.809728 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919d8ce-8820-49ba-be3e-da7361586346 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:44.810336 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919d8ce-8820-49ba-be3e-da7361586346 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:44.810801 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2919d8ce-8820-49ba-be3e-da7361586346 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:44.812656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 204/413] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:44.818046 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8edfda-d520-4a10-b4c5-42349907a625 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:44.818608 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8edfda-d520-4a10-b4c5-42349907a625 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:44.819076 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8edfda-d520-4a10-b4c5-42349907a625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:44.824144 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496d4428-431e-4beb-b97f-dc85f0878f1c None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:44.838929 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-8a8edfda-d520-4a10-b4c5-42349907a625 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:44.840579 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-8a8edfda-d520-4a10-b4c5-42349907a625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:44.863774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be5606a-e699-4533-bae1-7fd35a882cb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:44.864671 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5606a-e699-4533-bae1-7fd35a882cb5 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:44.864980 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5606a-e699-4533-bae1-7fd35a882cb5 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:44.865252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be5606a-e699-4533-bae1-7fd35a882cb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:44.876871 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5606a-e699-4533-bae1-7fd35a882cb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:44.879162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be5606a-e699-4533-bae1-7fd35a882cb5 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-6be5606a-e699-4533-bae1-7fd35a882cb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:44.894793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:44.895988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:44.896868 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:44.896868 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:44.896868 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:44.896868 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 210/414] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:44.897817 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b40f5-3d1b-4575-ada0-adff997f244d None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:44.897817 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b40f5-3d1b-4575-ada0-adff997f244d None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:44.897817 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462b40f5-3d1b-4575-ada0-adff997f244d None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:44.899108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 211/415] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:44.904083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b40f5-3d1b-4575-ada0-adff997f244d None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:44.917644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 205/416] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:44.919084 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996b90-68d4-47fd-84f1-db61f64fe9ce None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:44.919406 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996b90-68d4-47fd-84f1-db61f64fe9ce None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:44.919673 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7996b90-68d4-47fd-84f1-db61f64fe9ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:44.941094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-d7996b90-68d4-47fd-84f1-db61f64fe9ce None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:44.942542 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-d7996b90-68d4-47fd-84f1-db61f64fe9ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:44.996922 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:45.024208 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 206/417] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:45.025269 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914af5b2-0c00-40b3-abdd-8bfac23461eb None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.025548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914af5b2-0c00-40b3-abdd-8bfac23461eb None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.025817 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-914af5b2-0c00-40b3-abdd-8bfac23461eb None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.026120 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462b40f5-3d1b-4575-ada0-adff997f244d None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:45.027241 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 207/418] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:45.032398 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66284c9-b25c-46a3-9ead-5e126df7455c None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.032677 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66284c9-b25c-46a3-9ead-5e126df7455c None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.032942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66284c9-b25c-46a3-9ead-5e126df7455c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.039922 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:45.063121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3baafa-2d49-49d8-9ab3-5d70c5b1abe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:45.063764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3baafa-2d49-49d8-9ab3-5d70c5b1abe7 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.064038 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3baafa-2d49-49d8-9ab3-5d70c5b1abe7 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.064250 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-d66284c9-b25c-46a3-9ead-5e126df7455c None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:45.064357 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3baafa-2d49-49d8-9ab3-5d70c5b1abe7 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.064923 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3baafa-2d49-49d8-9ab3-5d70c5b1abe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:45.065218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3baafa-2d49-49d8-9ab3-5d70c5b1abe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:45.066011 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-d66284c9-b25c-46a3-9ead-5e126df7455c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:45.066593 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3baafa-2d49-49d8-9ab3-5d70c5b1abe7 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:45.082483 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 212/419] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:45.084250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3baafa-2d49-49d8-9ab3-5d70c5b1abe7 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.138320 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 208/420] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Oct 22 20:31:45.188987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3baafa-2d49-49d8-9ab3-5d70c5b1abe7 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:45.222895 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a9e30-18cf-40a4-bd9f-d19660ab64e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:45.223829 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9e30-18cf-40a4-bd9f-d19660ab64e0 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.224323 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9e30-18cf-40a4-bd9f-d19660ab64e0 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.224781 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4a9e30-18cf-40a4-bd9f-d19660ab64e0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.232943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a9e30-18cf-40a4-bd9f-d19660ab64e0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:45.234642 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4a9e30-18cf-40a4-bd9f-d19660ab64e0 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-1a4a9e30-18cf-40a4-bd9f-d19660ab64e0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:45.246109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:45.246961 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 20:31:45.247886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:45.250306 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 213/421] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:45.256181 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66284c9-b25c-46a3-9ead-5e126df7455c None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.264342 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a9e30-18cf-40a4-bd9f-d19660ab64e0 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.299045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:45.374992 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66284c9-b25c-46a3-9ead-5e126df7455c None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:45.375462 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4a9e30-18cf-40a4-bd9f-d19660ab64e0 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:45.377341 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:45.414115 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee9730-bb43-44b8-a864-17f4edd4581c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:45.414723 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee9730-bb43-44b8-a864-17f4edd4581c None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.414999 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee9730-bb43-44b8-a864-17f4edd4581c None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.415091 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae7cc-71ea-403b-8768-a4f4b37808d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:45.415283 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ee9730-bb43-44b8-a864-17f4edd4581c None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.415876 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae7cc-71ea-403b-8768-a4f4b37808d2 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.416022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee9730-bb43-44b8-a864-17f4edd4581c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:45.416267 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae7cc-71ea-403b-8768-a4f4b37808d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.416354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee9730-bb43-44b8-a864-17f4edd4581c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:45.416601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfae7cc-71ea-403b-8768-a4f4b37808d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.417734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ee9730-bb43-44b8-a864-17f4edd4581c None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:45.426604 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfae7cc-71ea-403b-8768-a4f4b37808d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-6cfae7cc-71ea-403b-8768-a4f4b37808d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:45.431886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:45.432730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:45.433490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 214/422] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:31:45.434753 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae7cc-71ea-403b-8768-a4f4b37808d2 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.440990 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 209/423] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:45.441817 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee9730-bb43-44b8-a864-17f4edd4581c None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.528024 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:45.536498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfae7cc-71ea-403b-8768-a4f4b37808d2 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:45.540113 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ee9730-bb43-44b8-a864-17f4edd4581c None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:45.570477 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3329b5-09f9-48d7-a05d-84e4d134e429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:45.571116 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3329b5-09f9-48d7-a05d-84e4d134e429 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.571400 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3329b5-09f9-48d7-a05d-84e4d134e429 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.571672 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3329b5-09f9-48d7-a05d-84e4d134e429 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.572952 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd6740-19e4-454f-8009-930255a99cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:45.573540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd6740-19e4-454f-8009-930255a99cb0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.573865 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd6740-19e4-454f-8009-930255a99cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.574147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcd6740-19e4-454f-8009-930255a99cb0 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.574795 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd6740-19e4-454f-8009-930255a99cb0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:45.575087 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd6740-19e4-454f-8009-930255a99cb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:45.576487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcd6740-19e4-454f-8009-930255a99cb0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:45.582743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3329b5-09f9-48d7-a05d-84e4d134e429 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:45.584704 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 210/424] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:45.585479 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd6740-19e4-454f-8009-930255a99cb0 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-9f3329b5-09f9-48d7-a05d-84e4d134e429 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:45.588020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:45.588864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:45.589640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:45.590228 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 215/425] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:45.590987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3329b5-09f9-48d7-a05d-84e4d134e429 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.609902 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:45.683740 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcd6740-19e4-454f-8009-930255a99cb0 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:45.689186 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3329b5-09f9-48d7-a05d-84e4d134e429 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:45.716294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc193a25-ef26-4332-b0e5-0cbdfc65ee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:45.716823 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc193a25-ef26-4332-b0e5-0cbdfc65ee33 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.717097 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc193a25-ef26-4332-b0e5-0cbdfc65ee33 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.717363 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc193a25-ef26-4332-b0e5-0cbdfc65ee33 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.720465 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e83c-c1c1-487c-a020-94c384be0f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:45.721070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e83c-c1c1-487c-a020-94c384be0f17 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.721340 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e83c-c1c1-487c-a020-94c384be0f17 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.721604 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b54e83c-c1c1-487c-a020-94c384be0f17 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.731709 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b54e83c-c1c1-487c-a020-94c384be0f17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-2b54e83c-c1c1-487c-a020-94c384be0f17 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:45.736729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:45.737732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 216/426] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:45.738528 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e83c-c1c1-487c-a020-94c384be0f17 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.753701 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:45.788728 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc193a25-ef26-4332-b0e5-0cbdfc65ee33 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:45.790176 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc193a25-ef26-4332-b0e5-0cbdfc65ee33 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:45.813604 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:45.836815 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b54e83c-c1c1-487c-a020-94c384be0f17 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:45.870258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09941fa3-70df-4156-bcd0-b4466009aab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:45.870875 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09941fa3-70df-4156-bcd0-b4466009aab4 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:45.871154 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09941fa3-70df-4156-bcd0-b4466009aab4 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:45.871456 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09941fa3-70df-4156-bcd0-b4466009aab4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:45.881707 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09941fa3-70df-4156-bcd0-b4466009aab4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:45.883142 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09941fa3-70df-4156-bcd0-b4466009aab4 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:45.887848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 211/427] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:45.888812 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc193a25-ef26-4332-b0e5-0cbdfc65ee33 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-09941fa3-70df-4156-bcd0-b4466009aab4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:45.901693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:45.902685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:45.903550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:45.903550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:45.903550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:45.903550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 217/428] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:45.904172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09941fa3-70df-4156-bcd0-b4466009aab4 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:45.965611 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:45.986968 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc193a25-ef26-4332-b0e5-0cbdfc65ee33 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.005103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09941fa3-70df-4156-bcd0-b4466009aab4 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.011680 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:46.023227 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64a658-bb76-4eb1-9eca-1e4b69f751fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.023898 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64a658-bb76-4eb1-9eca-1e4b69f751fb None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.024176 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64a658-bb76-4eb1-9eca-1e4b69f751fb None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.024446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa64a658-bb76-4eb1-9eca-1e4b69f751fb None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.025103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64a658-bb76-4eb1-9eca-1e4b69f751fb None admin] RBAC: Adding query filter params (name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:46.025412 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64a658-bb76-4eb1-9eca-1e4b69f751fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.026762 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa64a658-bb76-4eb1-9eca-1e4b69f751fb None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.034580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 212/429] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:46.035361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64a658-bb76-4eb1-9eca-1e4b69f751fb None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.038939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79274f-e59a-4499-bf01-a582cb7cbe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.039579 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79274f-e59a-4499-bf01-a582cb7cbe3f None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.039857 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79274f-e59a-4499-bf01-a582cb7cbe3f None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.040127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c79274f-e59a-4499-bf01-a582cb7cbe3f None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.040815 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79274f-e59a-4499-bf01-a582cb7cbe3f None admin] RBAC: Adding query filter params (name=service) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:46.041115 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79274f-e59a-4499-bf01-a582cb7cbe3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.042483 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c79274f-e59a-4499-bf01-a582cb7cbe3f None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.051039 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 218/430] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:31:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:46.051708 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79274f-e59a-4499-bf01-a582cb7cbe3f None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.138166 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa64a658-bb76-4eb1-9eca-1e4b69f751fb None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.149125 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c79274f-e59a-4499-bf01-a582cb7cbe3f None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.170994 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c749003-9797-4c2c-b5c8-2ba7fd1baad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.171632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c749003-9797-4c2c-b5c8-2ba7fd1baad3 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.171906 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c749003-9797-4c2c-b5c8-2ba7fd1baad3 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.172175 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c749003-9797-4c2c-b5c8-2ba7fd1baad3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.173494 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:46.182617 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d272d25-ac0c-4b53-ab5d-d43b1490bc94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.182753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c749003-9797-4c2c-b5c8-2ba7fd1baad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.183205 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d272d25-ac0c-4b53-ab5d-d43b1490bc94 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.183633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d272d25-ac0c-4b53-ab5d-d43b1490bc94 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.183900 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d272d25-ac0c-4b53-ab5d-d43b1490bc94 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.184227 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c749003-9797-4c2c-b5c8-2ba7fd1baad3 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.184529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d272d25-ac0c-4b53-ab5d-d43b1490bc94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:46.184823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d272d25-ac0c-4b53-ab5d-d43b1490bc94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.186172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d272d25-ac0c-4b53-ab5d-d43b1490bc94 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.197478 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 219/431] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-6c749003-9797-4c2c-b5c8-2ba7fd1baad3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:46.197912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:46.198744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:46.199614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:46.199614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:46.199614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:46.199773 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d272d25-ac0c-4b53-ab5d-d43b1490bc94 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.199839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 213/432] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:46.199839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c749003-9797-4c2c-b5c8-2ba7fd1baad3 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.241300 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:46.301427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d272d25-ac0c-4b53-ab5d-d43b1490bc94 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.302011 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c749003-9797-4c2c-b5c8-2ba7fd1baad3 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.334188 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7575d-df79-4613-b26f-1352c35b1316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.334795 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af367fdd-32f4-4a40-b981-c049f0c25fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.334906 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7575d-df79-4613-b26f-1352c35b1316 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.335066 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7575d-df79-4613-b26f-1352c35b1316 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.335356 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b7575d-df79-4613-b26f-1352c35b1316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.335448 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af367fdd-32f4-4a40-b981-c049f0c25fdb None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.335707 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af367fdd-32f4-4a40-b981-c049f0c25fdb None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.335974 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af367fdd-32f4-4a40-b981-c049f0c25fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.345121 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7575d-df79-4613-b26f-1352c35b1316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.345560 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af367fdd-32f4-4a40-b981-c049f0c25fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.346562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b7575d-df79-4613-b26f-1352c35b1316 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.346988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af367fdd-32f4-4a40-b981-c049f0c25fdb None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-e0b7575d-df79-4613-b26f-1352c35b1316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:46.361162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:46.362153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:46.363123 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:46.363123 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:46.363123 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-af367fdd-32f4-4a40-b981-c049f0c25fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:46.363335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:46.364334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:46.365280 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:46.365280 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:46.365280 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:46.365466 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 214/433] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:46.365466 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7575d-df79-4613-b26f-1352c35b1316 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.366033 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 220/434] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:46.367088 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af367fdd-32f4-4a40-b981-c049f0c25fdb None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.407231 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:46.459990 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:46.469065 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af367fdd-32f4-4a40-b981-c049f0c25fdb None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.469487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b7575d-df79-4613-b26f-1352c35b1316 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.502466 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd077858-4fab-45b3-bf32-bc0cb65636e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.502651 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2036cc-3071-456c-bbb8-b064e6585d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.502995 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077858-4fab-45b3-bf32-bc0cb65636e4 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.503086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2036cc-3071-456c-bbb8-b064e6585d5f None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.503305 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077858-4fab-45b3-bf32-bc0cb65636e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.503411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2036cc-3071-456c-bbb8-b064e6585d5f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.503564 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd077858-4fab-45b3-bf32-bc0cb65636e4 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.503649 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2036cc-3071-456c-bbb8-b064e6585d5f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.504201 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd077858-4fab-45b3-bf32-bc0cb65636e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:46.504499 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd077858-4fab-45b3-bf32-bc0cb65636e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.505910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd077858-4fab-45b3-bf32-bc0cb65636e4 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.511246 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2036cc-3071-456c-bbb8-b064e6585d5f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.512750 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2036cc-3071-456c-bbb8-b064e6585d5f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.516912 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 221/435] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:46.517708 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd077858-4fab-45b3-bf32-bc0cb65636e4 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-4f2036cc-3071-456c-bbb8-b064e6585d5f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:46.526025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:46.526913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 215/436] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:46.527917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2036cc-3071-456c-bbb8-b064e6585d5f None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.617123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:46.621348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd077858-4fab-45b3-bf32-bc0cb65636e4 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.627740 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2036cc-3071-456c-bbb8-b064e6585d5f None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.663472 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c31193-7687-4c81-91c0-be2d5fcd8a8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.664091 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c31193-7687-4c81-91c0-be2d5fcd8a8d None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.664359 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c31193-7687-4c81-91c0-be2d5fcd8a8d None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.664603 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c31193-7687-4c81-91c0-be2d5fcd8a8d None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.665238 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c31193-7687-4c81-91c0-be2d5fcd8a8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:46.665532 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c31193-7687-4c81-91c0-be2d5fcd8a8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.666887 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c31193-7687-4c81-91c0-be2d5fcd8a8d None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.667053 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a56b0-2e43-4c22-b412-fcbe20f299b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.667699 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a56b0-2e43-4c22-b412-fcbe20f299b3 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.667972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a56b0-2e43-4c22-b412-fcbe20f299b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.668221 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770a56b0-2e43-4c22-b412-fcbe20f299b3 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.668854 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a56b0-2e43-4c22-b412-fcbe20f299b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:46.669153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a56b0-2e43-4c22-b412-fcbe20f299b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.670517 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770a56b0-2e43-4c22-b412-fcbe20f299b3 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.683577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 222/437] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:46.683577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c31193-7687-4c81-91c0-be2d5fcd8a8d None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.683787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 216/438] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:46.684197 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a56b0-2e43-4c22-b412-fcbe20f299b3 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.695729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:46.778764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c31193-7687-4c81-91c0-be2d5fcd8a8d None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.780761 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770a56b0-2e43-4c22-b412-fcbe20f299b3 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.812302 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106082-3835-45e3-9531-cd2e159cef67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.812922 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106082-3835-45e3-9531-cd2e159cef67 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.813205 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106082-3835-45e3-9531-cd2e159cef67 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.813474 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec106082-3835-45e3-9531-cd2e159cef67 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.813719 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86795a7a-cf4f-4127-b334-056ab50d3199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.814316 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86795a7a-cf4f-4127-b334-056ab50d3199 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.814589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86795a7a-cf4f-4127-b334-056ab50d3199 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.814857 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86795a7a-cf4f-4127-b334-056ab50d3199 None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.815611 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86795a7a-cf4f-4127-b334-056ab50d3199 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:46.815906 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86795a7a-cf4f-4127-b334-056ab50d3199 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.817347 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86795a7a-cf4f-4127-b334-056ab50d3199 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.820127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec106082-3835-45e3-9531-cd2e159cef67 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.821548 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec106082-3835-45e3-9531-cd2e159cef67 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-ec106082-3835-45e3-9531-cd2e159cef67 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:46.832358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:46.833204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:46.834068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:46.834068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:46.834068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:46.834068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:46.834068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:46.834068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:46.834068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:46.834068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:46.834068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 223/439] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:46.834535 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 217/440] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:46.834610 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106082-3835-45e3-9531-cd2e159cef67 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.835248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86795a7a-cf4f-4127-b334-056ab50d3199 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.858914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:46.902895 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:46.935663 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86795a7a-cf4f-4127-b334-056ab50d3199 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.937834 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec106082-3835-45e3-9531-cd2e159cef67 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:46.969734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2a4ba-1a00-4922-b81c-d7077664e88d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.970342 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2a4ba-1a00-4922-b81c-d7077664e88d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.970614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2a4ba-1a00-4922-b81c-d7077664e88d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.970873 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a2a4ba-1a00-4922-b81c-d7077664e88d None admin] PATH_INFO: `/v3/users/glance` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.972612 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048847b-52d7-420d-9306-3e856803e3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:46.973225 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048847b-52d7-420d-9306-3e856803e3cc None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:46.973502 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048847b-52d7-420d-9306-3e856803e3cc None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:46.973767 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3048847b-52d7-420d-9306-3e856803e3cc None admin] PATH_INFO: `/v3/users/neutron` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:46.977846 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2a4ba-1a00-4922-b81c-d7077664e88d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.979598 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a2a4ba-1a00-4922-b81c-d7077664e88d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.981346 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048847b-52d7-420d-9306-3e856803e3cc None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:46.982796 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3048847b-52d7-420d-9306-3e856803e3cc None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-29a2a4ba-1a00-4922-b81c-d7077664e88d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:46.991095 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:46.992149 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 218/441] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/users/glance => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:46.993028 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2a4ba-1a00-4922-b81c-d7077664e88d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-3048847b-52d7-420d-9306-3e856803e3cc None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:46.993878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:46.994720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 224/442] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/users/neutron => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:46.995660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048847b-52d7-420d-9306-3e856803e3cc None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:47.075449 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:47.097358 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a2a4ba-1a00-4922-b81c-d7077664e88d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:47.097827 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3048847b-52d7-420d-9306-3e856803e3cc None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:47.122612 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:47.130169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ba099-ab97-40e8-b98a-0d14e8a3d5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:47.130312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0a2e4-2dce-43fe-ab05-0a4c16c5a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:47.130819 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba099-ab97-40e8-b98a-0d14e8a3d5af None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:47.130945 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0a2e4-2dce-43fe-ab05-0a4c16c5a2dd None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:47.131087 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba099-ab97-40e8-b98a-0d14e8a3d5af None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:47.131197 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0a2e4-2dce-43fe-ab05-0a4c16c5a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:47.131382 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0ba099-ab97-40e8-b98a-0d14e8a3d5af None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:47.131489 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f0a2e4-2dce-43fe-ab05-0a4c16c5a2dd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:47.132059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ba099-ab97-40e8-b98a-0d14e8a3d5af None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:47.132354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ba099-ab97-40e8-b98a-0d14e8a3d5af None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:47.133772 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0ba099-ab97-40e8-b98a-0d14e8a3d5af None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:47.145548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 219/443] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:47.146598 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ba099-ab97-40e8-b98a-0d14e8a3d5af None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:47.198487 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0a2e4-2dce-43fe-ab05-0a4c16c5a2dd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:47.199989 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f0a2e4-2dce-43fe-ab05-0a4c16c5a2dd None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:47.242254 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0ba099-ab97-40e8-b98a-0d14e8a3d5af None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:47.275868 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:47.277914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26407e6-e864-41dc-8e37-b7eb4740988d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:47.278537 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26407e6-e864-41dc-8e37-b7eb4740988d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:47.278766 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26407e6-e864-41dc-8e37-b7eb4740988d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:47.279027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26407e6-e864-41dc-8e37-b7eb4740988d None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:47.279774 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26407e6-e864-41dc-8e37-b7eb4740988d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:47.280066 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26407e6-e864-41dc-8e37-b7eb4740988d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:47.281494 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26407e6-e864-41dc-8e37-b7eb4740988d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:47.298249 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 220/444] 10.222.0.39 () {56 vars in 1137 bytes} [Sat Oct 22 20:31:47 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:47.298625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 225/445] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:47.299210 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26407e6-e864-41dc-8e37-b7eb4740988d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:47.299572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0a2e4-2dce-43fe-ab05-0a4c16c5a2dd None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:47.346387 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:47.399610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26407e6-e864-41dc-8e37-b7eb4740988d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:47.401236 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f0a2e4-2dce-43fe-ab05-0a4c16c5a2dd None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:47.433616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ea1e0-fc0c-40b1-ba89-53cdec1718f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:47.434215 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ea1e0-fc0c-40b1-ba89-53cdec1718f4 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:47.434477 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ea1e0-fc0c-40b1-ba89-53cdec1718f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:47.434651 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f1491-daf4-4393-9867-cf92e54e37f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:47.434790 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262ea1e0-fc0c-40b1-ba89-53cdec1718f4 None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:47.435239 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f1491-daf4-4393-9867-cf92e54e37f8 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:47.435438 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ea1e0-fc0c-40b1-ba89-53cdec1718f4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:47.435530 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f1491-daf4-4393-9867-cf92e54e37f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:47.435732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ea1e0-fc0c-40b1-ba89-53cdec1718f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:47.435826 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970f1491-daf4-4393-9867-cf92e54e37f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:47.436477 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f1491-daf4-4393-9867-cf92e54e37f8 None admin] RBAC: Adding query filter params (role.id=9f6b3138dda04fc884ae8e76a78e2865, scope.project.id=994d024676c1425fa15492ab23e267fd, user.id=a3b1e73612ed4e4c83784e77194d20e1) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:47.436774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f1491-daf4-4393-9867-cf92e54e37f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:47.437154 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262ea1e0-fc0c-40b1-ba89-53cdec1718f4 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:47.438159 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970f1491-daf4-4393-9867-cf92e54e37f8 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:47.443738 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 226/446] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:47 2022] GET /identity/v3/role_assignments?user.id=a3b1e73612ed4e4c83784e77194d20e1&scope.project.id=994d024676c1425fa15492ab23e267fd&role.id=9f6b3138dda04fc884ae8e76a78e2865 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:47.444486 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f1491-daf4-4393-9867-cf92e54e37f8 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:47.466626 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 221/447] 10.222.0.39 () {56 vars in 1139 bytes} [Sat Oct 22 20:31:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:47.468305 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ea1e0-fc0c-40b1-ba89-53cdec1718f4 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:47.492964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:47.563727 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970f1491-daf4-4393-9867-cf92e54e37f8 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:47.589996 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262ea1e0-fc0c-40b1-ba89-53cdec1718f4 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:47.592616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:47.601875 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a31707-8ef0-4280-b269-5643cd09de78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:47.602764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a31707-8ef0-4280-b269-5643cd09de78 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:47.603043 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a31707-8ef0-4280-b269-5643cd09de78 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:47.603625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a31707-8ef0-4280-b269-5643cd09de78 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:47.616624 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a31707-8ef0-4280-b269-5643cd09de78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:47.618161 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a31707-8ef0-4280-b269-5643cd09de78 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:47.628958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c4f34-da36-4cd4-a2d7-6a5bf62f632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:47.629572 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c4f34-da36-4cd4-a2d7-6a5bf62f632e None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:47.629873 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c4f34-da36-4cd4-a2d7-6a5bf62f632e None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:47.630141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55c4f34-da36-4cd4-a2d7-6a5bf62f632e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-23a31707-8ef0-4280-b269-5643cd09de78 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:47.635625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:47.636529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:47.637339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:47.637339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:47.637339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:47.638832 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 227/448] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:47.639836 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a31707-8ef0-4280-b269-5643cd09de78 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:47.714662 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c4f34-da36-4cd4-a2d7-6a5bf62f632e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:47.716488 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55c4f34-da36-4cd4-a2d7-6a5bf62f632e None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:47.746701 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:47.755167 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a31707-8ef0-4280-b269-5643cd09de78 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:47.792757 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42327a9-2658-458d-bb08-3ffb41214401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:47.793357 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42327a9-2658-458d-bb08-3ffb41214401 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:47.793618 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42327a9-2658-458d-bb08-3ffb41214401 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:47.793878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42327a9-2658-458d-bb08-3ffb41214401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:47.827035 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 222/449] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:47.828082 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c4f34-da36-4cd4-a2d7-6a5bf62f632e None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:47.831976 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:47.869291 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42327a9-2658-458d-bb08-3ffb41214401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:47.871204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42327a9-2658-458d-bb08-3ffb41214401 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:47.929565 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55c4f34-da36-4cd4-a2d7-6a5bf62f632e None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:47.964988 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbdcf0-bee1-496b-9098-fc3f270eb3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:47.965593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbdcf0-bee1-496b-9098-fc3f270eb3a2 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:47.965866 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbdcf0-bee1-496b-9098-fc3f270eb3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:47.966254 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cbdcf0-bee1-496b-9098-fc3f270eb3a2 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:47.966776 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbdcf0-bee1-496b-9098-fc3f270eb3a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:47.967079 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbdcf0-bee1-496b-9098-fc3f270eb3a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:47.968582 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cbdcf0-bee1-496b-9098-fc3f270eb3a2 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:47.979710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:47.988853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 223/450] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:47.988853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbdcf0-bee1-496b-9098-fc3f270eb3a2 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:47.995616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 228/451] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Oct 22 20:31:48.000350 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42327a9-2658-458d-bb08-3ffb41214401 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.053624 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:48.093046 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cbdcf0-bee1-496b-9098-fc3f270eb3a2 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.097681 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42327a9-2658-458d-bb08-3ffb41214401 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.129367 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f6386-f326-4c0a-ab1e-f7e5ae3efe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.129912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6386-f326-4c0a-ab1e-f7e5ae3efe96 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.130182 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6386-f326-4c0a-ab1e-f7e5ae3efe96 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.130443 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172f6386-f326-4c0a-ab1e-f7e5ae3efe96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.131249 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105dad-0b0c-48b5-abb5-52db71c8e8ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.131908 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105dad-0b0c-48b5-abb5-52db71c8e8ff None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.132191 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105dad-0b0c-48b5-abb5-52db71c8e8ff None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.132439 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50105dad-0b0c-48b5-abb5-52db71c8e8ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.139462 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105dad-0b0c-48b5-abb5-52db71c8e8ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.140643 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f6386-f326-4c0a-ab1e-f7e5ae3efe96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.140930 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50105dad-0b0c-48b5-abb5-52db71c8e8ff None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.142192 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172f6386-f326-4c0a-ab1e-f7e5ae3efe96 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-50105dad-0b0c-48b5-abb5-52db71c8e8ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:48.152109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:48.152943 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:48.153788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:48.153788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:48.153788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:48.153788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:48.153788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:48.153788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:48.153788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:48.153788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:48.153788 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 229/452] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:48.154246 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105dad-0b0c-48b5-abb5-52db71c8e8ff None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-172f6386-f326-4c0a-ab1e-f7e5ae3efe96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:48.163729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:48.164628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:48.165435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:48.165435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:48.165435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:48.165435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 224/453] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:48.166158 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f6386-f326-4c0a-ab1e-f7e5ae3efe96 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.215029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:48.263246 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50105dad-0b0c-48b5-abb5-52db71c8e8ff None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.269496 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172f6386-f326-4c0a-ab1e-f7e5ae3efe96 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.285700 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:48.302187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778c9b-3992-494d-a94c-4dd5d39f8d98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.302886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778c9b-3992-494d-a94c-4dd5d39f8d98 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.303164 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778c9b-3992-494d-a94c-4dd5d39f8d98 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.303467 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5778c9b-3992-494d-a94c-4dd5d39f8d98 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.304356 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bfb04-ef86-4faa-87c1-5fe9fb46683a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.305038 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfb04-ef86-4faa-87c1-5fe9fb46683a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.305414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfb04-ef86-4faa-87c1-5fe9fb46683a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.305687 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577bfb04-ef86-4faa-87c1-5fe9fb46683a None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.306371 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bfb04-ef86-4faa-87c1-5fe9fb46683a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:48.306674 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bfb04-ef86-4faa-87c1-5fe9fb46683a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.308139 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577bfb04-ef86-4faa-87c1-5fe9fb46683a None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.314334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5778c9b-3992-494d-a94c-4dd5d39f8d98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.315886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5778c9b-3992-494d-a94c-4dd5d39f8d98 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.319848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 225/454] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:48.325014 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bfb04-ef86-4faa-87c1-5fe9fb46683a None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-b5778c9b-3992-494d-a94c-4dd5d39f8d98 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:48.333958 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:48.334999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:48.336040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:48.336040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:48.336040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:48.336485 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 230/455] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:48.338089 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778c9b-3992-494d-a94c-4dd5d39f8d98 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.436810 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577bfb04-ef86-4faa-87c1-5fe9fb46683a None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.447538 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5778c9b-3992-494d-a94c-4dd5d39f8d98 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.454431 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:48.474411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ef0b-9c49-4e75-9307-8ee8d805fd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.475004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ef0b-9c49-4e75-9307-8ee8d805fd76 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.475295 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ef0b-9c49-4e75-9307-8ee8d805fd76 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.475566 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c02ef0b-9c49-4e75-9307-8ee8d805fd76 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.476195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02ef0b-9c49-4e75-9307-8ee8d805fd76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:48.476486 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02ef0b-9c49-4e75-9307-8ee8d805fd76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.477857 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c02ef0b-9c49-4e75-9307-8ee8d805fd76 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.483189 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe1a8-d52b-4da8-b67d-75724251e42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.483869 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe1a8-d52b-4da8-b67d-75724251e42e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.484199 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe1a8-d52b-4da8-b67d-75724251e42e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.484963 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cfe1a8-d52b-4da8-b67d-75724251e42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.485748 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfe1a8-d52b-4da8-b67d-75724251e42e None admin] RBAC: Adding query filter params (role.id=9f6b3138dda04fc884ae8e76a78e2865, scope.project.id=994d024676c1425fa15492ab23e267fd, user.id=c0efaeef0d724cc69ce9daa0f70856d8) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:48.486545 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfe1a8-d52b-4da8-b67d-75724251e42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.488079 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cfe1a8-d52b-4da8-b67d-75724251e42e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.493735 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 226/456] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:48.493735 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ef0b-9c49-4e75-9307-8ee8d805fd76 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.500776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 231/457] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/role_assignments?user.id=c0efaeef0d724cc69ce9daa0f70856d8&scope.project.id=994d024676c1425fa15492ab23e267fd&role.id=9f6b3138dda04fc884ae8e76a78e2865 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:48.501695 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe1a8-d52b-4da8-b67d-75724251e42e None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.546980 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:48.642848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c02ef0b-9c49-4e75-9307-8ee8d805fd76 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.664825 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cfe1a8-d52b-4da8-b67d-75724251e42e None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.689400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3d32a-2bb2-4afe-88ef-afd4956f28a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.690480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3d32a-2bb2-4afe-88ef-afd4956f28a4 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.690958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3d32a-2bb2-4afe-88ef-afd4956f28a4 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.691458 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e3d32a-2bb2-4afe-88ef-afd4956f28a4 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.692313 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3d32a-2bb2-4afe-88ef-afd4956f28a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:48.692896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3d32a-2bb2-4afe-88ef-afd4956f28a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.694568 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e3d32a-2bb2-4afe-88ef-afd4956f28a4 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.707303 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f0d7b-fb04-443c-bb81-9506a10c6ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.707966 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f0d7b-fb04-443c-bb81-9506a10c6ea1 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.708235 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f0d7b-fb04-443c-bb81-9506a10c6ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.708616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f0d7b-fb04-443c-bb81-9506a10c6ea1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.708977 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 227/458] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:48.715315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3d32a-2bb2-4afe-88ef-afd4956f28a4 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.716676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f0d7b-fb04-443c-bb81-9506a10c6ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.718377 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7f0d7b-fb04-443c-bb81-9506a10c6ea1 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-cd7f0d7b-fb04-443c-bb81-9506a10c6ea1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:48.734158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:48.735023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:48.736146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:48.736146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:48.736146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:48.736146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:48.736146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:48.736146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:48.736146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:48.736146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:48.736146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 232/459] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:48.742264 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f0d7b-fb04-443c-bb81-9506a10c6ea1 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.775516 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:48.830104 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:48.836330 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e3d32a-2bb2-4afe-88ef-afd4956f28a4 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.873378 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e4763-4d92-4507-aeca-636c7281630f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.874181 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e4763-4d92-4507-aeca-636c7281630f None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.874549 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e4763-4d92-4507-aeca-636c7281630f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.874910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9e4763-4d92-4507-aeca-636c7281630f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.875277 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f0d7b-fb04-443c-bb81-9506a10c6ea1 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:48.882219 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e4763-4d92-4507-aeca-636c7281630f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.883843 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9e4763-4d92-4507-aeca-636c7281630f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-dc9e4763-4d92-4507-aeca-636c7281630f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:48.896576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:48.897614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:48.898657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:48.898657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:48.898657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:48.898657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:48.898657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:48.898657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:48.898657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:48.898657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:48.904890 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 228/460] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:48.905860 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e4763-4d92-4507-aeca-636c7281630f None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:48.918916 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeafd62-e47f-4838-b29e-ee57d485a812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:48.920180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeafd62-e47f-4838-b29e-ee57d485a812 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:48.920870 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeafd62-e47f-4838-b29e-ee57d485a812 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:48.921283 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeafd62-e47f-4838-b29e-ee57d485a812 None admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:48.922370 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeafd62-e47f-4838-b29e-ee57d485a812 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:48.922814 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeafd62-e47f-4838-b29e-ee57d485a812 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:48.925193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeafd62-e47f-4838-b29e-ee57d485a812 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:48.942390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 233/461] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:48.948359 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeafd62-e47f-4838-b29e-ee57d485a812 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:49.038595 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9e4763-4d92-4507-aeca-636c7281630f None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:49.042274 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:49.054302 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeafd62-e47f-4838-b29e-ee57d485a812 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:49.079139 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce41956-da3e-475f-8e2e-02dae280b00e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:49.080003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41956-da3e-475f-8e2e-02dae280b00e None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:49.080438 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41956-da3e-475f-8e2e-02dae280b00e None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:49.080845 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce41956-da3e-475f-8e2e-02dae280b00e None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:49.081669 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce41956-da3e-475f-8e2e-02dae280b00e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:49.082129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce41956-da3e-475f-8e2e-02dae280b00e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:49.084022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce41956-da3e-475f-8e2e-02dae280b00e None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:49.090206 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8186dc-8208-4369-ae07-c656ff24196c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:49.090995 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8186dc-8208-4369-ae07-c656ff24196c None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:49.091457 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8186dc-8208-4369-ae07-c656ff24196c None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:49.091822 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8186dc-8208-4369-ae07-c656ff24196c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:49.092633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8186dc-8208-4369-ae07-c656ff24196c None admin] RBAC: Adding query filter params (role.id=9f6b3138dda04fc884ae8e76a78e2865, scope.project.id=994d024676c1425fa15492ab23e267fd, user.id=54a843b5fd164017b662b4a3eafc8ac0) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:49.093032 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8186dc-8208-4369-ae07-c656ff24196c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:49.094866 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8186dc-8208-4369-ae07-c656ff24196c None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:49.098312 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 229/462] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:49.103924 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce41956-da3e-475f-8e2e-02dae280b00e None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:49.111308 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 234/463] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:48 2022] GET /identity/v3/role_assignments?user.id=54a843b5fd164017b662b4a3eafc8ac0&scope.project.id=994d024676c1425fa15492ab23e267fd&role.id=9f6b3138dda04fc884ae8e76a78e2865 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:49.130286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:49.219736 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce41956-da3e-475f-8e2e-02dae280b00e None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:49.262484 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45398a29-0dc1-44b9-88e8-1f7414f71829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:49.263414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398a29-0dc1-44b9-88e8-1f7414f71829 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:49.263850 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398a29-0dc1-44b9-88e8-1f7414f71829 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:49.264259 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45398a29-0dc1-44b9-88e8-1f7414f71829 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:49.265136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45398a29-0dc1-44b9-88e8-1f7414f71829 None admin] RBAC: Adding query filter params (role.id=9f6b3138dda04fc884ae8e76a78e2865, scope.project.id=994d024676c1425fa15492ab23e267fd, user.id=7f526e9ac6094156aa57f280c4de4f29) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:49.265583 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45398a29-0dc1-44b9-88e8-1f7414f71829 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:49.267204 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45398a29-0dc1-44b9-88e8-1f7414f71829 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:49.274985 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 230/464] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:49 2022] GET /identity/v3/role_assignments?user.id=7f526e9ac6094156aa57f280c4de4f29&scope.project.id=994d024676c1425fa15492ab23e267fd&role.id=9f6b3138dda04fc884ae8e76a78e2865 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:49.885183 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084220-6d1c-42bd-ae42-a80866457bad None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:49.885586 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084220-6d1c-42bd-ae42-a80866457bad None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:49.885775 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05084220-6d1c-42bd-ae42-a80866457bad None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:49.887188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 235/465] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:49.892689 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ace46-21ff-49ca-854f-bc2040f83ad4 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:49.892974 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ace46-21ff-49ca-854f-bc2040f83ad4 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:49.893250 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97ace46-21ff-49ca-854f-bc2040f83ad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:49.912007 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-e97ace46-21ff-49ca-854f-bc2040f83ad4 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:49.913287 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-e97ace46-21ff-49ca-854f-bc2040f83ad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:49.986300 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 231/466] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:50.305879 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084220-6d1c-42bd-ae42-a80866457bad None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:50.418595 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05084220-6d1c-42bd-ae42-a80866457bad None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:50.455362 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bca147-ee34-4f82-a496-47b73768a232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:50.456002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca147-ee34-4f82-a496-47b73768a232 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:50.456272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca147-ee34-4f82-a496-47b73768a232 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:50.456543 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bca147-ee34-4f82-a496-47b73768a232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:50.467455 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6bca147-ee34-4f82-a496-47b73768a232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-b6bca147-ee34-4f82-a496-47b73768a232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:50.472272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:50.473122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:50.473891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 236/467] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:31:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:50.480623 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ace46-21ff-49ca-854f-bc2040f83ad4 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:50.493053 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:50.589932 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97ace46-21ff-49ca-854f-bc2040f83ad4 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:50.627576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fb443-2842-44ca-b420-2ac7da424942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:50.628179 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fb443-2842-44ca-b420-2ac7da424942 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:50.628454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fb443-2842-44ca-b420-2ac7da424942 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:50.628720 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771fb443-2842-44ca-b420-2ac7da424942 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:50.629382 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fb443-2842-44ca-b420-2ac7da424942 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:50.629710 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fb443-2842-44ca-b420-2ac7da424942 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:50.631113 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771fb443-2842-44ca-b420-2ac7da424942 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:50.640071 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 232/468] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:50.645636 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bca147-ee34-4f82-a496-47b73768a232 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:50.695621 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:50.756361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bca147-ee34-4f82-a496-47b73768a232 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:50.791760 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d468f52-1deb-48e5-a546-e0644d751981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:50.792389 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d468f52-1deb-48e5-a546-e0644d751981 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:50.792663 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d468f52-1deb-48e5-a546-e0644d751981 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:50.792931 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d468f52-1deb-48e5-a546-e0644d751981 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:50.803116 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d468f52-1deb-48e5-a546-e0644d751981 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:50.804607 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d468f52-1deb-48e5-a546-e0644d751981 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-0d468f52-1deb-48e5-a546-e0644d751981 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:50.819130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:50.819994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:50.821209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:50.821209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:50.821209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:50.821209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 237/469] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:50.828365 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fb443-2842-44ca-b420-2ac7da424942 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:50.904154 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:50.935964 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771fb443-2842-44ca-b420-2ac7da424942 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:50.970066 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84c46ad-507e-4a68-8c1f-303078e45752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:50.970979 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c46ad-507e-4a68-8c1f-303078e45752 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:50.971456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c46ad-507e-4a68-8c1f-303078e45752 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:50.971897 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c46ad-507e-4a68-8c1f-303078e45752 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:50.972709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c46ad-507e-4a68-8c1f-303078e45752 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:50.973179 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c46ad-507e-4a68-8c1f-303078e45752 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:50.974804 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84c46ad-507e-4a68-8c1f-303078e45752 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:50.988535 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 233/470] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:50.994361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d468f52-1deb-48e5-a546-e0644d751981 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:51.014992 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa94f9-5f53-4eb4-a1d1-384945098b80 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.015348 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa94f9-5f53-4eb4-a1d1-384945098b80 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.015621 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6faa94f9-5f53-4eb4-a1d1-384945098b80 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.017144 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 234/471] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:31:51.022854 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8f463-9c4e-44b6-903b-32a9f594dac9 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.023133 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8f463-9c4e-44b6-903b-32a9f594dac9 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.023425 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8f463-9c4e-44b6-903b-32a9f594dac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.045092 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-06d8f463-9c4e-44b6-903b-32a9f594dac9 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:51.047043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-06d8f463-9c4e-44b6-903b-32a9f594dac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:51.073417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:51.111412 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d468f52-1deb-48e5-a546-e0644d751981 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:51.136027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 235/472] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:51.150751 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b5126-f530-41ca-a71c-5b532f4454dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:51.151760 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b5126-f530-41ca-a71c-5b532f4454dd None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.152225 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b5126-f530-41ca-a71c-5b532f4454dd None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.152676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b5126-f530-41ca-a71c-5b532f4454dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.160780 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b5126-f530-41ca-a71c-5b532f4454dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:51.162504 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92b5126-f530-41ca-a71c-5b532f4454dd None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-a92b5126-f530-41ca-a71c-5b532f4454dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:51.173890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:51.174766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 20:31:51.175662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:51.178232 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 238/473] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Oct 22 20:31:50 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:51.184354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8f463-9c4e-44b6-903b-32a9f594dac9 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:51.252488 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:51.292622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8f463-9c4e-44b6-903b-32a9f594dac9 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:51.327656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3f9a3-d797-4d20-be43-17f48001e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:51.328345 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3f9a3-d797-4d20-be43-17f48001e910 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.328620 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3f9a3-d797-4d20-be43-17f48001e910 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.328887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b3f9a3-d797-4d20-be43-17f48001e910 None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.329618 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3f9a3-d797-4d20-be43-17f48001e910 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:51.329916 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3f9a3-d797-4d20-be43-17f48001e910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:51.331381 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b3f9a3-d797-4d20-be43-17f48001e910 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:51.349524 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 236/474] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Oct 22 20:31:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:51.355103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b5126-f530-41ca-a71c-5b532f4454dd None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:51.474829 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92b5126-f530-41ca-a71c-5b532f4454dd None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:51.484044 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3f9a3-d797-4d20-be43-17f48001e910 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:51.507783 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:51.517143 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab47d-aefd-49b3-ad39-0f3fe019be6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:51.517907 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab47d-aefd-49b3-ad39-0f3fe019be6d None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.518190 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab47d-aefd-49b3-ad39-0f3fe019be6d None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.518460 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bab47d-aefd-49b3-ad39-0f3fe019be6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.530338 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab47d-aefd-49b3-ad39-0f3fe019be6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:51.532058 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bab47d-aefd-49b3-ad39-0f3fe019be6d None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-54bab47d-aefd-49b3-ad39-0f3fe019be6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:51.548745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:51.549688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:51.550520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:51.550520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:51.550520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:51.550520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 239/475] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:51.555621 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab47d-aefd-49b3-ad39-0f3fe019be6d None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:51.609597 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b3f9a3-d797-4d20-be43-17f48001e910 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:51.632961 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:51.648955 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab805c5-d0c1-440c-a52f-9b108e79ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:51.649584 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab805c5-d0c1-440c-a52f-9b108e79ccd8 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.649859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab805c5-d0c1-440c-a52f-9b108e79ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.650315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab805c5-d0c1-440c-a52f-9b108e79ccd8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.650704 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab805c5-d0c1-440c-a52f-9b108e79ccd8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:51.652098 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab805c5-d0c1-440c-a52f-9b108e79ccd8 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-8ab805c5-d0c1-440c-a52f-9b108e79ccd8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:51.662887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:51.663868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:51.664632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 237/476] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Oct 22 20:31:51 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:51.666207 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bab47d-aefd-49b3-ad39-0f3fe019be6d None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:51.666324 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482881-8772-4e0b-bbc8-dbce9c4a5c64 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.666324 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482881-8772-4e0b-bbc8-dbce9c4a5c64 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.666324 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e482881-8772-4e0b-bbc8-dbce9c4a5c64 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.671312 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 238/477] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:51.671312 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482881-8772-4e0b-bbc8-dbce9c4a5c64 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:51.703895 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220b091-2ed6-4c1d-aa44-76e876b9d647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:51.704495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220b091-2ed6-4c1d-aa44-76e876b9d647 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.704765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220b091-2ed6-4c1d-aa44-76e876b9d647 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.705030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220b091-2ed6-4c1d-aa44-76e876b9d647 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.705665 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220b091-2ed6-4c1d-aa44-76e876b9d647 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:51.705960 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220b091-2ed6-4c1d-aa44-76e876b9d647 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:51.707335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220b091-2ed6-4c1d-aa44-76e876b9d647 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:51.719287 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 240/478] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:51.723541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c381e6-b380-47ba-b939-e6bb27d47236 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.723541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c381e6-b380-47ba-b939-e6bb27d47236 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.723541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c381e6-b380-47ba-b939-e6bb27d47236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.742786 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-91c381e6-b380-47ba-b939-e6bb27d47236 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:51.744520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-91c381e6-b380-47ba-b939-e6bb27d47236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:51.774748 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:51.783755 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e482881-8772-4e0b-bbc8-dbce9c4a5c64 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:51.815292 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 241/479] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:51.815953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c381e6-b380-47ba-b939-e6bb27d47236 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:51.823140 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca49e2a6-a073-49d1-a9ed-f5a2d0925a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:51.823987 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49e2a6-a073-49d1-a9ed-f5a2d0925a2d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.824435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49e2a6-a073-49d1-a9ed-f5a2d0925a2d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.824900 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca49e2a6-a073-49d1-a9ed-f5a2d0925a2d None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.825723 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49e2a6-a073-49d1-a9ed-f5a2d0925a2d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:51.826191 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49e2a6-a073-49d1-a9ed-f5a2d0925a2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:51.827781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca49e2a6-a073-49d1-a9ed-f5a2d0925a2d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:51.832827 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 239/480] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Oct 22 20:31:51 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:51.834377 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f327dbd-790e-46e5-a69e-5a39f93e9e90 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.834859 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f327dbd-790e-46e5-a69e-5a39f93e9e90 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.835342 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f327dbd-790e-46e5-a69e-5a39f93e9e90 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.837056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 240/481] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:51.838445 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f327dbd-790e-46e5-a69e-5a39f93e9e90 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:51.893232 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:51.928688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c381e6-b380-47ba-b939-e6bb27d47236 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:51.951483 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f327dbd-790e-46e5-a69e-5a39f93e9e90 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:51.964577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572f99b-4eee-4b58-aa67-6aea17b13f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:51.965222 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572f99b-4eee-4b58-aa67-6aea17b13f5c None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.965520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572f99b-4eee-4b58-aa67-6aea17b13f5c None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.965744 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572f99b-4eee-4b58-aa67-6aea17b13f5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.972417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572f99b-4eee-4b58-aa67-6aea17b13f5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:51.973901 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9572f99b-4eee-4b58-aa67-6aea17b13f5c None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-9572f99b-4eee-4b58-aa67-6aea17b13f5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:51.986099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:51.986973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:51.988215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:51.988215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:51.988215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:51.988215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:51.988215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:51.988215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:51.988215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:51.988215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:51.988215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 242/482] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:51.988828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c5e2e-ae9a-4364-bca2-d50a09be5257 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.988828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c5e2e-ae9a-4364-bca2-d50a09be5257 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.988828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9c5e2e-ae9a-4364-bca2-d50a09be5257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.993634 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272c534-cec5-446a-8613-a6e610f0798b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:51.994188 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272c534-cec5-446a-8613-a6e610f0798b None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:51.994465 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272c534-cec5-446a-8613-a6e610f0798b None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:51.994737 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f272c534-cec5-446a-8613-a6e610f0798b None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:51.995411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272c534-cec5-446a-8613-a6e610f0798b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:51.995712 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272c534-cec5-446a-8613-a6e610f0798b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:51.997103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f272c534-cec5-446a-8613-a6e610f0798b None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:52.007358 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 241/483] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Oct 22 20:31:51 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:52.007358 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272c534-cec5-446a-8613-a6e610f0798b None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:52.017169 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-5e9c5e2e-ae9a-4364-bca2-d50a09be5257 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:52.019353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-5e9c5e2e-ae9a-4364-bca2-d50a09be5257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:52.055490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:52.109454 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 243/484] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:52.138578 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c5e2e-ae9a-4364-bca2-d50a09be5257 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:52.145542 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f272c534-cec5-446a-8613-a6e610f0798b None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:52.160164 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:52.184647 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49ca7-80bf-4428-a805-4a859b79c50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:52.185352 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49ca7-80bf-4428-a805-4a859b79c50a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:52.185729 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49ca7-80bf-4428-a805-4a859b79c50a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:52.186043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c49ca7-80bf-4428-a805-4a859b79c50a None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:52.186813 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49ca7-80bf-4428-a805-4a859b79c50a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:52.187177 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49ca7-80bf-4428-a805-4a859b79c50a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:52.188743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c49ca7-80bf-4428-a805-4a859b79c50a None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:52.209445 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 242/485] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:52.211798 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49ca7-80bf-4428-a805-4a859b79c50a None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:52.284776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9c5e2e-ae9a-4364-bca2-d50a09be5257 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:52.330153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c49ca7-80bf-4428-a805-4a859b79c50a None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:52.330900 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4494db-4e2c-4726-85d1-fdcb60a1554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:52.331917 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4494db-4e2c-4726-85d1-fdcb60a1554b None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:52.332560 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4494db-4e2c-4726-85d1-fdcb60a1554b None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:52.332831 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4494db-4e2c-4726-85d1-fdcb60a1554b None admin] PATH_INFO: `/v3/services/image` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:52.333462 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4494db-4e2c-4726-85d1-fdcb60a1554b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:52.334894 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4494db-4e2c-4726-85d1-fdcb60a1554b None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-2e4494db-4e2c-4726-85d1-fdcb60a1554b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:52.347216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:52.348272 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:52.349131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 244/486] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Oct 22 20:31:52 2022] GET /identity/v3/services/image => generated 86 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:52.355162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4494db-4e2c-4726-85d1-fdcb60a1554b None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:52.376989 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed7005-0a45-42ba-a4ac-1b352619aa21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:52.377873 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7005-0a45-42ba-a4ac-1b352619aa21 None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:52.378294 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7005-0a45-42ba-a4ac-1b352619aa21 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:52.378703 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beed7005-0a45-42ba-a4ac-1b352619aa21 None admin] PATH_INFO: `/v3/projects/994d024676c1425fa15492ab23e267fd/users/a3b1e73612ed4e4c83784e77194d20e1/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:52.381698 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed7005-0a45-42ba-a4ac-1b352619aa21 None admin] RBAC: Authorizing `identity:create_grant(project_id=994d024676c1425fa15492ab23e267fd, user_id=a3b1e73612ed4e4c83784e77194d20e1, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:52.382405 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:52.386795 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beed7005-0a45-42ba-a4ac-1b352619aa21 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:52.414304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 243/487] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:31:52 2022] PUT /identity/v3/projects/994d024676c1425fa15492ab23e267fd/users/a3b1e73612ed4e4c83784e77194d20e1/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:31:52.426428 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed7005-0a45-42ba-a4ac-1b352619aa21 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:52.467981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:52.502525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4494db-4e2c-4726-85d1-fdcb60a1554b None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:52.546033 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beed7005-0a45-42ba-a4ac-1b352619aa21 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:52.550496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54102a0-135c-4f39-9c94-e46f62cae162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:52.551370 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54102a0-135c-4f39-9c94-e46f62cae162 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:52.551897 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54102a0-135c-4f39-9c94-e46f62cae162 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:52.552380 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54102a0-135c-4f39-9c94-e46f62cae162 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:52.553174 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54102a0-135c-4f39-9c94-e46f62cae162 None admin] RBAC: Adding query filter params (name=image) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:52.553620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54102a0-135c-4f39-9c94-e46f62cae162 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:52.555582 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54102a0-135c-4f39-9c94-e46f62cae162 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:52.565092 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 245/488] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:52 2022] GET /identity/v3/services?name=image => generated 122 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:52.571055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54102a0-135c-4f39-9c94-e46f62cae162 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:52.594307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5e654-d9b1-49be-b188-5775ea4a6a7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:52.595983 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5e654-d9b1-49be-b188-5775ea4a6a7c None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:52.596791 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5e654-d9b1-49be-b188-5775ea4a6a7c None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:52.597328 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b5e654-d9b1-49be-b188-5775ea4a6a7c None admin] PATH_INFO: `/v3/services/network` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:52.598514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5e654-d9b1-49be-b188-5775ea4a6a7c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:52.601668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b5e654-d9b1-49be-b188-5775ea4a6a7c None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-b2b5e654-d9b1-49be-b188-5775ea4a6a7c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:52.615085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:52.616116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:52.616921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 244/489] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:52 2022] GET /identity/v3/services/network => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:52.623528 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5e654-d9b1-49be-b188-5775ea4a6a7c None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:52.686990 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:52.710049 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54102a0-135c-4f39-9c94-e46f62cae162 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:52.740829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:52.748966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b5e654-d9b1-49be-b188-5775ea4a6a7c None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:52.757467 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04149-f304-49d4-9ca6-2fee3ca64886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:52.758717 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04149-f304-49d4-9ca6-2fee3ca64886 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:52.759134 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04149-f304-49d4-9ca6-2fee3ca64886 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:52.759579 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba04149-f304-49d4-9ca6-2fee3ca64886 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:52.760833 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04149-f304-49d4-9ca6-2fee3ca64886 None admin] RBAC: Adding query filter params (type=image) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:52.761419 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04149-f304-49d4-9ca6-2fee3ca64886 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:52.763345 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba04149-f304-49d4-9ca6-2fee3ca64886 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:52.771030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 246/490] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:52 2022] GET /identity/v3/services?type=image => generated 122 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:52.793879 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c21dafb-114a-4183-83ae-0dfc2b53d244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:52.794753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21dafb-114a-4183-83ae-0dfc2b53d244 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:52.795165 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21dafb-114a-4183-83ae-0dfc2b53d244 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:52.795788 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c21dafb-114a-4183-83ae-0dfc2b53d244 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:52.796766 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21dafb-114a-4183-83ae-0dfc2b53d244 None admin] RBAC: Adding query filter params (name=network) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:52.797230 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21dafb-114a-4183-83ae-0dfc2b53d244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:52.798851 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c21dafb-114a-4183-83ae-0dfc2b53d244 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:52.805383 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 245/491] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:31:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:52.811302 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04149-f304-49d4-9ca6-2fee3ca64886 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:52.921603 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba04149-f304-49d4-9ca6-2fee3ca64886 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:52.959583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59474c0e-7825-4d62-bc0f-4ecef071c5c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:52.960442 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59474c0e-7825-4d62-bc0f-4ecef071c5c2 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:52.960854 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59474c0e-7825-4d62-bc0f-4ecef071c5c2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:52.961257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59474c0e-7825-4d62-bc0f-4ecef071c5c2 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:52.962030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59474c0e-7825-4d62-bc0f-4ecef071c5c2 None admin] RBAC: Adding query filter params (type=network) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:52.962494 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59474c0e-7825-4d62-bc0f-4ecef071c5c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:52.964125 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59474c0e-7825-4d62-bc0f-4ecef071c5c2 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:52.969960 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 247/492] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:31:52 2022] GET /identity/v3/services?type=network => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:54.515557 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4e10-580a-4978-9648-0ba97e7ceada None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:54.516594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4e10-580a-4978-9648-0ba97e7ceada None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:54.517060 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf4e10-580a-4978-9648-0ba97e7ceada None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:54.519199 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 246/493] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:54.524757 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58172904-401a-44f5-b607-f6f51cc7898c None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:54.525531 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58172904-401a-44f5-b607-f6f51cc7898c None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:54.526006 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58172904-401a-44f5-b607-f6f51cc7898c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:54.544803 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-58172904-401a-44f5-b607-f6f51cc7898c None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:54.546297 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-58172904-401a-44f5-b607-f6f51cc7898c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:54.556224 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:54.616374 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 248/494] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:54.909606 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1f581-8914-4e35-a15e-8430804d4b64 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:54.910259 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1f581-8914-4e35-a15e-8430804d4b64 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:54.910715 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa1f581-8914-4e35-a15e-8430804d4b64 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:54.912594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 247/495] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:54.917721 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953297-fc7b-454a-8b8c-653517d16ed9 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:54.918010 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953297-fc7b-454a-8b8c-653517d16ed9 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:54.918284 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e953297-fc7b-454a-8b8c-653517d16ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:54.938401 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-9e953297-fc7b-454a-8b8c-653517d16ed9 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:54.939742 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-9e953297-fc7b-454a-8b8c-653517d16ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:54.959543 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1f581-8914-4e35-a15e-8430804d4b64 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:55.034678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 249/496] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:55.080868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa1f581-8914-4e35-a15e-8430804d4b64 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:55.116350 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f82b331-fb16-4e30-af44-b390e3068a14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:55.117280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b331-fb16-4e30-af44-b390e3068a14 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:55.117838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b331-fb16-4e30-af44-b390e3068a14 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:55.118297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f82b331-fb16-4e30-af44-b390e3068a14 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:55.119160 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b331-fb16-4e30-af44-b390e3068a14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:55.120731 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f82b331-fb16-4e30-af44-b390e3068a14 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:55.140111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 248/497] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:31:54 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 20:31:55.226578 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838c24-0eee-424c-a229-3e27d6babb8d None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:55.227016 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838c24-0eee-424c-a229-3e27d6babb8d None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:55.227475 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d838c24-0eee-424c-a229-3e27d6babb8d None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:55.229677 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 250/498] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:55.236016 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbd79c-0f10-4402-b269-0b5ff810cd1b None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:55.236617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbd79c-0f10-4402-b269-0b5ff810cd1b None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:55.237079 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41cbd79c-0f10-4402-b269-0b5ff810cd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:55.257484 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-41cbd79c-0f10-4402-b269-0b5ff810cd1b None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:55.259071 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-41cbd79c-0f10-4402-b269-0b5ff810cd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:55.275839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:55.342778 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 249/499] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:55.359874 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb8615-df4d-470b-8e80-e5156f9def7e None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:55.360541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb8615-df4d-470b-8e80-e5156f9def7e None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:55.361092 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cb8615-df4d-470b-8e80-e5156f9def7e None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:55.362956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 251/500] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:55.368966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78736bd5-b27b-4773-84c3-447f3d77f293 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:55.369515 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78736bd5-b27b-4773-84c3-447f3d77f293 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:55.369988 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78736bd5-b27b-4773-84c3-447f3d77f293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:55.374268 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb8615-df4d-470b-8e80-e5156f9def7e None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:55.394361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-78736bd5-b27b-4773-84c3-447f3d77f293 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:55.395065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-78736bd5-b27b-4773-84c3-447f3d77f293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:55.466703 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:55.475001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 250/501] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:55 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Oct 22 20:31:55.502440 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cb8615-df4d-470b-8e80-e5156f9def7e None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:55.536842 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae438cd3-aeda-4293-b3db-3195c60f437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:55.537574 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae438cd3-aeda-4293-b3db-3195c60f437a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:55.537826 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae438cd3-aeda-4293-b3db-3195c60f437a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:55.538095 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae438cd3-aeda-4293-b3db-3195c60f437a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:55.548612 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae438cd3-aeda-4293-b3db-3195c60f437a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-ae438cd3-aeda-4293-b3db-3195c60f437a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:31:55.553498 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:55.554349 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:55.555108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 252/502] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:31:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:31:55.560753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78736bd5-b27b-4773-84c3-447f3d77f293 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:55.646998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:55.659939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae438cd3-aeda-4293-b3db-3195c60f437a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:55.672472 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78736bd5-b27b-4773-84c3-447f3d77f293 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:55.709453 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e2710-894d-400c-9af4-8d5431203793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:55.710161 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e2710-894d-400c-9af4-8d5431203793 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:55.710442 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e2710-894d-400c-9af4-8d5431203793 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:55.710710 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890e2710-894d-400c-9af4-8d5431203793 None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:55.711405 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e2710-894d-400c-9af4-8d5431203793 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:55.711761 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e2710-894d-400c-9af4-8d5431203793 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:55.713303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890e2710-894d-400c-9af4-8d5431203793 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:55.722580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 251/503] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:31:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:55.729657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e2710-894d-400c-9af4-8d5431203793 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:55.778563 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae438cd3-aeda-4293-b3db-3195c60f437a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:55.823737 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dde01-1df5-4b10-8c6a-206d593b6f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:55.824624 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dde01-1df5-4b10-8c6a-206d593b6f5e None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:55.824922 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dde01-1df5-4b10-8c6a-206d593b6f5e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:55.825609 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6dde01-1df5-4b10-8c6a-206d593b6f5e None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:55.826511 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dde01-1df5-4b10-8c6a-206d593b6f5e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:55.828088 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6dde01-1df5-4b10-8c6a-206d593b6f5e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:55.832371 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:55.843895 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890e2710-894d-400c-9af4-8d5431203793 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:55.848166 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 253/504] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:31:55 2022] POST /identity/v3/services => generated 242 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 20:31:55.848914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dde01-1df5-4b10-8c6a-206d593b6f5e None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:55.906483 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6e5f3-f031-44a6-bf4b-3f6308a72f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:55.908071 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6e5f3-f031-44a6-bf4b-3f6308a72f2c None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:55.908538 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6e5f3-f031-44a6-bf4b-3f6308a72f2c None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:55.908985 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e6e5f3-f031-44a6-bf4b-3f6308a72f2c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:55.912555 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:55.931154 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6e5f3-f031-44a6-bf4b-3f6308a72f2c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:55.932684 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e6e5f3-f031-44a6-bf4b-3f6308a72f2c None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-d0e6e5f3-f031-44a6-bf4b-3f6308a72f2c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:55.961794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:55.962936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:55.963828 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:55.963828 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:55.963828 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:55.967447 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 252/505] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:55.971182 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6e5f3-f031-44a6-bf4b-3f6308a72f2c None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:55.980022 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6dde01-1df5-4b10-8c6a-206d593b6f5e None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:56.020281 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93c4c7-a53d-41f4-ac61-fdea256bf741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:56.021172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93c4c7-a53d-41f4-ac61-fdea256bf741 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:56.021518 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93c4c7-a53d-41f4-ac61-fdea256bf741 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:56.021855 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc93c4c7-a53d-41f4-ac61-fdea256bf741 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:56.022620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93c4c7-a53d-41f4-ac61-fdea256bf741 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:56.024238 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc93c4c7-a53d-41f4-ac61-fdea256bf741 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:56.051379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 254/506] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:31:55 2022] POST /identity/v3/services => generated 240 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:31:56.126664 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e6e5f3-f031-44a6-bf4b-3f6308a72f2c None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:56.172914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a679c30-7f0c-441c-89f2-8307ded1a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:56.173574 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a679c30-7f0c-441c-89f2-8307ded1a183 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:56.173852 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a679c30-7f0c-441c-89f2-8307ded1a183 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:56.174115 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a679c30-7f0c-441c-89f2-8307ded1a183 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:56.174803 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a679c30-7f0c-441c-89f2-8307ded1a183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:56.175097 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a679c30-7f0c-441c-89f2-8307ded1a183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:56.176560 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a679c30-7f0c-441c-89f2-8307ded1a183 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:56.190453 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 253/507] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:56.196062 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93c4c7-a53d-41f4-ac61-fdea256bf741 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:56.259598 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:56.306293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc93c4c7-a53d-41f4-ac61-fdea256bf741 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:56.342991 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e742e-f679-4a0d-904d-a897e01c3064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:56.343658 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e742e-f679-4a0d-904d-a897e01c3064 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:56.343932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e742e-f679-4a0d-904d-a897e01c3064 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:56.344199 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7e742e-f679-4a0d-904d-a897e01c3064 None admin] PATH_INFO: `/v3/users/nova` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:56.352112 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e742e-f679-4a0d-904d-a897e01c3064 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:56.353552 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7e742e-f679-4a0d-904d-a897e01c3064 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-5a7e742e-f679-4a0d-904d-a897e01c3064 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:31:56.365339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:56.366348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Oct 22 20:31:56.367218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:56.371191 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 255/508] 10.222.0.39 () {56 vars in 1093 bytes} [Sat Oct 22 20:31:56 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:56.372559 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a679c30-7f0c-441c-89f2-8307ded1a183 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:56.421482 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:56.485202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a679c30-7f0c-441c-89f2-8307ded1a183 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:56.521628 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac7bbc-328b-4fa1-afc6-87a7e98aa3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:56.522235 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac7bbc-328b-4fa1-afc6-87a7e98aa3db None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:56.522568 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac7bbc-328b-4fa1-afc6-87a7e98aa3db None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:56.522839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fac7bbc-328b-4fa1-afc6-87a7e98aa3db None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:56.523603 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac7bbc-328b-4fa1-afc6-87a7e98aa3db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:56.523896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac7bbc-328b-4fa1-afc6-87a7e98aa3db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:56.525327 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fac7bbc-328b-4fa1-afc6-87a7e98aa3db None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:56.548828 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 254/509] 10.222.0.39 () {56 vars in 1133 bytes} [Sat Oct 22 20:31:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:56.550191 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e742e-f679-4a0d-904d-a897e01c3064 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:56.662496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7e742e-f679-4a0d-904d-a897e01c3064 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:56.678569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:56.700030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146351-f2c0-49e5-90f3-3d7d30ba5a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:56.700643 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146351-f2c0-49e5-90f3-3d7d30ba5a5b None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:56.700917 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146351-f2c0-49e5-90f3-3d7d30ba5a5b None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:56.701184 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a146351-f2c0-49e5-90f3-3d7d30ba5a5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:56.769818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146351-f2c0-49e5-90f3-3d7d30ba5a5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:56.771352 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a146351-f2c0-49e5-90f3-3d7d30ba5a5b None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:56.871460 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 256/510] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:31:56 2022] GET /identity/v3/auth/tokens => generated 1098 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 20:31:56.874694 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac7bbc-328b-4fa1-afc6-87a7e98aa3db None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:56.974877 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:56.978004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fac7bbc-328b-4fa1-afc6-87a7e98aa3db None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:57.014290 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31672e-c889-4d13-9822-1bf9212e5c4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:57.014968 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31672e-c889-4d13-9822-1bf9212e5c4b None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:57.015248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31672e-c889-4d13-9822-1bf9212e5c4b None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:57.015541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31672e-c889-4d13-9822-1bf9212e5c4b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:57.025914 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31672e-c889-4d13-9822-1bf9212e5c4b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:57.027399 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e31672e-c889-4d13-9822-1bf9212e5c4b None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-0e31672e-c889-4d13-9822-1bf9212e5c4b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:31:57.042141 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:57.044370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:31:57.046562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:31:57.046562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:31:57.046562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:57.051522 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 255/511] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:57.051736 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146351-f2c0-49e5-90f3-3d7d30ba5a5b None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:57.095673 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:57.153856 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a146351-f2c0-49e5-90f3-3d7d30ba5a5b None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:57.188761 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f459edf-195d-49d3-9605-4636154b7e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:57.189361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459edf-195d-49d3-9605-4636154b7e91 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:57.189625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459edf-195d-49d3-9605-4636154b7e91 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:57.189881 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f459edf-195d-49d3-9605-4636154b7e91 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:57.190513 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459edf-195d-49d3-9605-4636154b7e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:57.190807 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459edf-195d-49d3-9605-4636154b7e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:57.192184 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f459edf-195d-49d3-9605-4636154b7e91 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:57.204127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 257/512] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:31:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:57.209600 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31672e-c889-4d13-9822-1bf9212e5c4b None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:57.316471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31672e-c889-4d13-9822-1bf9212e5c4b None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:57.355936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035d0ce-c2a6-4344-b8b2-ca342275cfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:57.356564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035d0ce-c2a6-4344-b8b2-ca342275cfa9 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:57.356838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035d0ce-c2a6-4344-b8b2-ca342275cfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:57.357111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d035d0ce-c2a6-4344-b8b2-ca342275cfa9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:57.364396 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035d0ce-c2a6-4344-b8b2-ca342275cfa9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:57.365917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d035d0ce-c2a6-4344-b8b2-ca342275cfa9 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-d035d0ce-c2a6-4344-b8b2-ca342275cfa9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:31:57.377593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:57.379594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:57.381786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:31:57.381786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:31:57.381786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:31:57.381786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:31:57.381786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:31:57.381786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:31:57.381786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:31:57.381786 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:57.387288 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 256/513] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:57.387492 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f459edf-195d-49d3-9605-4636154b7e91 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:57.461228 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:57.487087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f459edf-195d-49d3-9605-4636154b7e91 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:57.519603 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9a5dd2-bc3f-4275-b844-daf8ad48d694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:57.520207 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a5dd2-bc3f-4275-b844-daf8ad48d694 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:57.520480 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a5dd2-bc3f-4275-b844-daf8ad48d694 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:57.520780 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9a5dd2-bc3f-4275-b844-daf8ad48d694 None admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:57.521521 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a5dd2-bc3f-4275-b844-daf8ad48d694 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:57.521823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a5dd2-bc3f-4275-b844-daf8ad48d694 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:57.523375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9a5dd2-bc3f-4275-b844-daf8ad48d694 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:57.540662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 258/514] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:31:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:57.542068 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035d0ce-c2a6-4344-b8b2-ca342275cfa9 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:57.571738 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:57.647513 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d035d0ce-c2a6-4344-b8b2-ca342275cfa9 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:57.680315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed3f80d-21f0-42b4-b6d7-124ec52fad3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:57.680915 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3f80d-21f0-42b4-b6d7-124ec52fad3d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:57.681188 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3f80d-21f0-42b4-b6d7-124ec52fad3d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:57.681456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed3f80d-21f0-42b4-b6d7-124ec52fad3d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:57.682176 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3f80d-21f0-42b4-b6d7-124ec52fad3d None admin] RBAC: Adding query filter params (role.id=7fb86065b4ef4b98873a590a9c66cfdc, scope.project.id=994d024676c1425fa15492ab23e267fd, user.id=a3b1e73612ed4e4c83784e77194d20e1) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:57.682477 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3f80d-21f0-42b4-b6d7-124ec52fad3d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:57.683939 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed3f80d-21f0-42b4-b6d7-124ec52fad3d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:57.695436 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 257/515] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:31:57 2022] GET /identity/v3/role_assignments?user.id=a3b1e73612ed4e4c83784e77194d20e1&scope.project.id=994d024676c1425fa15492ab23e267fd&role.id=7fb86065b4ef4b98873a590a9c66cfdc => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:57.772258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069753bf-2985-4426-a8be-524270053c72 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:57.773220 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069753bf-2985-4426-a8be-524270053c72 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:57.773709 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069753bf-2985-4426-a8be-524270053c72 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:57.775549 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 259/516] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:31:57.781488 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def5a0-00c0-457f-a2f9-50591ff4d1de None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:57.782118 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def5a0-00c0-457f-a2f9-50591ff4d1de None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:57.782578 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13def5a0-00c0-457f-a2f9-50591ff4d1de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:57.801777 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-13def5a0-00c0-457f-a2f9-50591ff4d1de None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:57.803461 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-13def5a0-00c0-457f-a2f9-50591ff4d1de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:57.879555 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 258/517] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:57 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:31:58.201627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069753bf-2985-4426-a8be-524270053c72 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:58.303996 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069753bf-2985-4426-a8be-524270053c72 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:58.337088 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b942fd-a3d6-4821-9947-65dfbc443db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:58.337721 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b942fd-a3d6-4821-9947-65dfbc443db2 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:58.337999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b942fd-a3d6-4821-9947-65dfbc443db2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:58.338260 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b942fd-a3d6-4821-9947-65dfbc443db2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:58.338833 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b942fd-a3d6-4821-9947-65dfbc443db2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:58.340259 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b942fd-a3d6-4821-9947-65dfbc443db2 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:58.342074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-10b942fd-a3d6-4821-9947-65dfbc443db2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:58.350572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:58.351616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:58.352529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 260/518] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Oct 22 20:31:58 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:31:58.360575 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13def5a0-00c0-457f-a2f9-50591ff4d1de None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:58.368877 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:58.394099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3103-c65a-4900-9d7d-8ef714debe58 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:58.394640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3103-c65a-4900-9d7d-8ef714debe58 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:58.395712 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82a3103-c65a-4900-9d7d-8ef714debe58 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:58.397439 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 261/519] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:31:58.402879 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe327-a655-44f6-88f9-3ca7b6956a35 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:58.403388 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe327-a655-44f6-88f9-3ca7b6956a35 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:58.403818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4fe327-a655-44f6-88f9-3ca7b6956a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:58.422485 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-8a4fe327-a655-44f6-88f9-3ca7b6956a35 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:58.423710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-8a4fe327-a655-44f6-88f9-3ca7b6956a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:58.481165 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13def5a0-00c0-457f-a2f9-50591ff4d1de None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:58.506458 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 262/520] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:31:58.518024 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e81556-b7c1-4282-9d77-7ed588600df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:58.518943 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81556-b7c1-4282-9d77-7ed588600df7 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:58.519445 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81556-b7c1-4282-9d77-7ed588600df7 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:58.519903 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e81556-b7c1-4282-9d77-7ed588600df7 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:58.520938 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81556-b7c1-4282-9d77-7ed588600df7 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:58.521441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81556-b7c1-4282-9d77-7ed588600df7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:58.523008 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e81556-b7c1-4282-9d77-7ed588600df7 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:58.528370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 259/521] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Oct 22 20:31:58 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:58.534162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe327-a655-44f6-88f9-3ca7b6956a35 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:58.633044 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4fe327-a655-44f6-88f9-3ca7b6956a35 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:58.647918 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e96a3-8180-47d5-b056-a43c226ecbaa None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:58.648545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e96a3-8180-47d5-b056-a43c226ecbaa None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:58.649013 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174e96a3-8180-47d5-b056-a43c226ecbaa None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:58.651135 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 260/522] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:31:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:31:58.656429 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93380d3-750d-4fc8-a2d5-e06034d51002 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:58.657007 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93380d3-750d-4fc8-a2d5-e06034d51002 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:58.657470 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93380d3-750d-4fc8-a2d5-e06034d51002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:58.660920 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:58.669127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175a901-7359-44fa-b761-1460b5fb010d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:58.669745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a901-7359-44fa-b761-1460b5fb010d None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:58.670410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a901-7359-44fa-b761-1460b5fb010d None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:58.670932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2175a901-7359-44fa-b761-1460b5fb010d None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:58.671888 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175a901-7359-44fa-b761-1460b5fb010d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:58.672561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175a901-7359-44fa-b761-1460b5fb010d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:58.674076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2175a901-7359-44fa-b761-1460b5fb010d None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:58.683303 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 263/523] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Oct 22 20:31:58 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:58.685028 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175a901-7359-44fa-b761-1460b5fb010d None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:58.691976 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-b93380d3-750d-4fc8-a2d5-e06034d51002 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:31:58.693654 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-b93380d3-750d-4fc8-a2d5-e06034d51002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:31:58.772355 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:58.784033 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 261/524] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:31:58 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 20:31:58.796687 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2175a901-7359-44fa-b761-1460b5fb010d None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:58.830827 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed732db2-0f39-4967-8534-1d0b48b28b4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:58.831776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed732db2-0f39-4967-8534-1d0b48b28b4a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:58.832211 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed732db2-0f39-4967-8534-1d0b48b28b4a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:58.832415 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93380d3-750d-4fc8-a2d5-e06034d51002 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:58.832784 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed732db2-0f39-4967-8534-1d0b48b28b4a None admin] PATH_INFO: `/v3/endpoints` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:58.833677 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed732db2-0f39-4967-8534-1d0b48b28b4a None admin] RBAC: Adding query filter params (interface=public, service_id=27d647b7045c4b3a9773635ad38a4268, region_id=RegionOne) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:58.834129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed732db2-0f39-4967-8534-1d0b48b28b4a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:58.835672 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed732db2-0f39-4967-8534-1d0b48b28b4a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:58.847426 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 264/525] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Oct 22 20:31:58 2022] GET /identity/v3/endpoints?service_id=27d647b7045c4b3a9773635ad38a4268&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:58.853887 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed732db2-0f39-4967-8534-1d0b48b28b4a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:58.921087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:58.959372 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93380d3-750d-4fc8-a2d5-e06034d51002 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:58.970514 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed732db2-0f39-4967-8534-1d0b48b28b4a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:58.996155 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbbd07-3b3a-40a3-a5ce-0a80eda4b283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:58.997090 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbbd07-3b3a-40a3-a5ce-0a80eda4b283 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:58.997654 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbbd07-3b3a-40a3-a5ce-0a80eda4b283 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:58.998074 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbbbd07-3b3a-40a3-a5ce-0a80eda4b283 None admin] PATH_INFO: `/v3/services/image` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:58.999238 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbbd07-3b3a-40a3-a5ce-0a80eda4b283 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.001142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbbbd07-3b3a-40a3-a5ce-0a80eda4b283 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.009360 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bb72e-2faa-4ffb-a7e5-0f2a9d7ccf32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:59.010068 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bb72e-2faa-4ffb-a7e5-0f2a9d7ccf32 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:59.010406 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bb72e-2faa-4ffb-a7e5-0f2a9d7ccf32 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:59.010742 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0bb72e-2faa-4ffb-a7e5-0f2a9d7ccf32 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:59.011505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bb72e-2faa-4ffb-a7e5-0f2a9d7ccf32 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-bcbbbd07-3b3a-40a3-a5ce-0a80eda4b283 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:59.012660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:59.013878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 20:31:59.014962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:31:59.015899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0bb72e-2faa-4ffb-a7e5-0f2a9d7ccf32 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.017889 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 262/526] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Oct 22 20:31:58 2022] GET /identity/v3/services/image => generated 86 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:31:59.023702 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbbd07-3b3a-40a3-a5ce-0a80eda4b283 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:59.025804 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 265/527] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Oct 22 20:31:58 2022] GET /identity/v3/services => generated 1002 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:31:59.094241 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:59.139375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bb72e-2faa-4ffb-a7e5-0f2a9d7ccf32 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:59.139962 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbbbd07-3b3a-40a3-a5ce-0a80eda4b283 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:59.189311 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637f613-5577-4bdb-8ef7-5a6125bfac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:59.190533 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637f613-5577-4bdb-8ef7-5a6125bfac4a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:59.190969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637f613-5577-4bdb-8ef7-5a6125bfac4a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:59.191428 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1637f613-5577-4bdb-8ef7-5a6125bfac4a None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:59.192497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637f613-5577-4bdb-8ef7-5a6125bfac4a None admin] RBAC: Adding query filter params (name=image) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:59.193016 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637f613-5577-4bdb-8ef7-5a6125bfac4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.195435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1637f613-5577-4bdb-8ef7-5a6125bfac4a None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.202877 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 263/528] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:59.209172 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637f613-5577-4bdb-8ef7-5a6125bfac4a None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:59.267989 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0bb72e-2faa-4ffb-a7e5-0f2a9d7ccf32 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:59.292992 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:59.315117 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ed4d9-6b91-40f7-9e4a-da922847b76f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:59.315815 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ed4d9-6b91-40f7-9e4a-da922847b76f None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:59.316087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ed4d9-6b91-40f7-9e4a-da922847b76f None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:59.316353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610ed4d9-6b91-40f7-9e4a-da922847b76f None admin] PATH_INFO: `/v3/services/network` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:59.316931 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ed4d9-6b91-40f7-9e4a-da922847b76f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.318318 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610ed4d9-6b91-40f7-9e4a-da922847b76f None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-610ed4d9-6b91-40f7-9e4a-da922847b76f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:31:59.326925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:31:59.327957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:31:59.328774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 266/529] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:31:59 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:31:59.335985 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ed4d9-6b91-40f7-9e4a-da922847b76f None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:59.347154 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1637f613-5577-4bdb-8ef7-5a6125bfac4a None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:59.379406 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:59.388993 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448273c3-52bb-4942-9ccb-fb88f732cc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:59.391706 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448273c3-52bb-4942-9ccb-fb88f732cc92 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:59.392222 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448273c3-52bb-4942-9ccb-fb88f732cc92 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:59.392709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448273c3-52bb-4942-9ccb-fb88f732cc92 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:59.393570 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448273c3-52bb-4942-9ccb-fb88f732cc92 None admin] RBAC: Adding query filter params (type=image) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:59.394886 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448273c3-52bb-4942-9ccb-fb88f732cc92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.396734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448273c3-52bb-4942-9ccb-fb88f732cc92 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.409373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 264/530] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:31:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:31:59.415892 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448273c3-52bb-4942-9ccb-fb88f732cc92 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:59.462560 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610ed4d9-6b91-40f7-9e4a-da922847b76f None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:59.507752 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4d5b3-a2f4-4997-bbdc-6e4d07e0387d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:59.508779 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4d5b3-a2f4-4997-bbdc-6e4d07e0387d None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:59.509322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4d5b3-a2f4-4997-bbdc-6e4d07e0387d None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:59.509785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d4d5b3-a2f4-4997-bbdc-6e4d07e0387d None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:59.510609 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4d5b3-a2f4-4997-bbdc-6e4d07e0387d None admin] RBAC: Adding query filter params (name=network) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:59.511109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4d5b3-a2f4-4997-bbdc-6e4d07e0387d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.512773 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d4d5b3-a2f4-4997-bbdc-6e4d07e0387d None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.518586 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 267/531] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:31:59 2022] GET /identity/v3/services?name=network => generated 124 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:59.523837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4d5b3-a2f4-4997-bbdc-6e4d07e0387d None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:59.538197 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448273c3-52bb-4942-9ccb-fb88f732cc92 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:59.575209 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c6b0-42d7-46d0-a3cf-5ee9aef871f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:59.575811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c6b0-42d7-46d0-a3cf-5ee9aef871f9 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:59.576093 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c6b0-42d7-46d0-a3cf-5ee9aef871f9 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:59.576365 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c6b0-42d7-46d0-a3cf-5ee9aef871f9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:59.577180 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00c6b0-42d7-46d0-a3cf-5ee9aef871f9 None admin] RBAC: Adding query filter params (interface=public, service_id=8ecfc11ac5334815a8167ff97d87c2b8, region_id=RegionOne) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:59.577458 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00c6b0-42d7-46d0-a3cf-5ee9aef871f9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.578839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00c6b0-42d7-46d0-a3cf-5ee9aef871f9 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.580277 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:59.589067 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 265/532] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Oct 22 20:31:59 2022] GET /identity/v3/endpoints?service_id=8ecfc11ac5334815a8167ff97d87c2b8&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:59.594856 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c6b0-42d7-46d0-a3cf-5ee9aef871f9 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:59.640079 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d4d5b3-a2f4-4997-bbdc-6e4d07e0387d None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:59.655979 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:59.682433 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02437e63-fada-4d93-9980-4e7f9a3ba85a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:59.683458 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02437e63-fada-4d93-9980-4e7f9a3ba85a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:59.683929 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02437e63-fada-4d93-9980-4e7f9a3ba85a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:59.684395 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02437e63-fada-4d93-9980-4e7f9a3ba85a None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:59.685233 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02437e63-fada-4d93-9980-4e7f9a3ba85a None admin] RBAC: Adding query filter params (type=network) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:59.685732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02437e63-fada-4d93-9980-4e7f9a3ba85a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.687307 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02437e63-fada-4d93-9980-4e7f9a3ba85a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.696110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 268/533] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:31:59 2022] GET /identity/v3/services?type=network => generated 350 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:59.701390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02437e63-fada-4d93-9980-4e7f9a3ba85a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:59.722213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c6b0-42d7-46d0-a3cf-5ee9aef871f9 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:59.770002 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992049-68a9-41c0-a23d-8c5ea52bf163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:59.771239 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992049-68a9-41c0-a23d-8c5ea52bf163 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:59.771764 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992049-68a9-41c0-a23d-8c5ea52bf163 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:59.772234 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5992049-68a9-41c0-a23d-8c5ea52bf163 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:59.773275 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5992049-68a9-41c0-a23d-8c5ea52bf163 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.775439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5992049-68a9-41c0-a23d-8c5ea52bf163 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.783101 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 266/534] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Oct 22 20:31:59 2022] GET /identity/v3/services => generated 1002 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 20:31:59.815907 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02437e63-fada-4d93-9980-4e7f9a3ba85a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:31:59.851365 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:31:59.855680 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782d9b0e-00db-480b-8583-c6c7a6afef05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:31:59.856724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d9b0e-00db-480b-8583-c6c7a6afef05 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:31:59.857194 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d9b0e-00db-480b-8583-c6c7a6afef05 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:31:59.857664 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782d9b0e-00db-480b-8583-c6c7a6afef05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:31:59.858599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d9b0e-00db-480b-8583-c6c7a6afef05 None admin] RBAC: Adding query filter params (interface=public, service_id=39e81dc8607d4948960d6c8988a5cd7d, region_id=RegionOne) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:31:59.859124 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d9b0e-00db-480b-8583-c6c7a6afef05 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:31:59.861428 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782d9b0e-00db-480b-8583-c6c7a6afef05 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:31:59.868323 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 269/535] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Oct 22 20:31:59 2022] GET /identity/v3/endpoints?service_id=39e81dc8607d4948960d6c8988a5cd7d&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:31:59.876433 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992049-68a9-41c0-a23d-8c5ea52bf163 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:31:59.986333 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5992049-68a9-41c0-a23d-8c5ea52bf163 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:00.009516 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:00.023393 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18a920c-59d3-4f56-ad4d-3c2c3b2324d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:00.023990 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a920c-59d3-4f56-ad4d-3c2c3b2324d3 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:00.024260 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a920c-59d3-4f56-ad4d-3c2c3b2324d3 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:00.024521 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18a920c-59d3-4f56-ad4d-3c2c3b2324d3 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:00.025115 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a920c-59d3-4f56-ad4d-3c2c3b2324d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:00.026487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18a920c-59d3-4f56-ad4d-3c2c3b2324d3 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:00.032169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 267/536] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Oct 22 20:31:59 2022] GET /identity/v3/services => generated 1002 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:32:00.152346 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c41c9e-8a2d-44c9-b82d-2c3948445d4a None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:00.152550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c41c9e-8a2d-44c9-b82d-2c3948445d4a None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:00.152793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c41c9e-8a2d-44c9-b82d-2c3948445d4a None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:00.154139 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 270/537] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:00.160161 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9257-ddde-4645-bf40-b824b8f40532 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:00.160445 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9257-ddde-4645-bf40-b824b8f40532 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:00.160701 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23a9257-ddde-4645-bf40-b824b8f40532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:00.180216 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-c23a9257-ddde-4645-bf40-b824b8f40532 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:00.181434 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-c23a9257-ddde-4645-bf40-b824b8f40532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:00.256449 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 268/538] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:00 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:00.587787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c41c9e-8a2d-44c9-b82d-2c3948445d4a None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:00.689416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c41c9e-8a2d-44c9-b82d-2c3948445d4a None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:00.722784 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb1496-c128-4515-90b6-7211fd2e2a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:00.723457 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb1496-c128-4515-90b6-7211fd2e2a61 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:00.723749 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb1496-c128-4515-90b6-7211fd2e2a61 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:00.724018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fb1496-c128-4515-90b6-7211fd2e2a61 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:00.724602 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb1496-c128-4515-90b6-7211fd2e2a61 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:00.725974 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fb1496-c128-4515-90b6-7211fd2e2a61 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-67fb1496-c128-4515-90b6-7211fd2e2a61 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:00.735562 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:00.736493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:00.737422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 271/539] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Oct 22 20:32:00 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:00.743088 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a9257-ddde-4645-bf40-b824b8f40532 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:00.849739 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23a9257-ddde-4645-bf40-b824b8f40532 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:00.865152 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:00.885727 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b31c8b-e9c9-46cd-b442-36c38fd62e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:00.886633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31c8b-e9c9-46cd-b442-36c38fd62e89 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:00.887110 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31c8b-e9c9-46cd-b442-36c38fd62e89 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:00.887625 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b31c8b-e9c9-46cd-b442-36c38fd62e89 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:00.888450 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31c8b-e9c9-46cd-b442-36c38fd62e89 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:00.888970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31c8b-e9c9-46cd-b442-36c38fd62e89 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:00.890537 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b31c8b-e9c9-46cd-b442-36c38fd62e89 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:00.895843 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 269/540] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Oct 22 20:32:00 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:00.904366 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb1496-c128-4515-90b6-7211fd2e2a61 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:00.945710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:01.006078 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fb1496-c128-4515-90b6-7211fd2e2a61 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:01.039941 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e454552-7279-46af-8284-74a9a3c6fc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:01.040640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e454552-7279-46af-8284-74a9a3c6fc82 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:01.040917 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e454552-7279-46af-8284-74a9a3c6fc82 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:01.041188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e454552-7279-46af-8284-74a9a3c6fc82 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:01.041814 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e454552-7279-46af-8284-74a9a3c6fc82 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:01.042110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e454552-7279-46af-8284-74a9a3c6fc82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:01.043564 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e454552-7279-46af-8284-74a9a3c6fc82 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:01.048394 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 272/541] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Oct 22 20:32:00 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:01.643227 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff524c9-271b-4ac5-a9ad-81b4ac88e057 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:01.644239 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff524c9-271b-4ac5-a9ad-81b4ac88e057 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:01.644781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff524c9-271b-4ac5-a9ad-81b4ac88e057 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:01.646632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 270/542] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:01.652305 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedef95-e8a9-4fdb-998e-c8ab08e365bc None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:01.652590 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedef95-e8a9-4fdb-998e-c8ab08e365bc None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:01.652863 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedef95-e8a9-4fdb-998e-c8ab08e365bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:01.671105 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-ddedef95-e8a9-4fdb-998e-c8ab08e365bc None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:01.672392 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-ddedef95-e8a9-4fdb-998e-c8ab08e365bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:01.738908 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 273/543] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:01 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:02.062907 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff524c9-271b-4ac5-a9ad-81b4ac88e057 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:02.171125 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff524c9-271b-4ac5-a9ad-81b4ac88e057 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:02.203382 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c9c2-da4d-4ba2-b17a-57cfd5320a59 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:02.203934 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c9c2-da4d-4ba2-b17a-57cfd5320a59 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:02.203934 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3066c9c2-da4d-4ba2-b17a-57cfd5320a59 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:02.206825 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 274/544] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:02.210809 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b24f13-ce68-4a14-86ba-d4275504c3cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:02.211486 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69038f1-010e-4433-b18e-5249d9404086 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:02.211776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69038f1-010e-4433-b18e-5249d9404086 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:02.212049 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69038f1-010e-4433-b18e-5249d9404086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:02.212367 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24f13-ce68-4a14-86ba-d4275504c3cf None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:02.212853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24f13-ce68-4a14-86ba-d4275504c3cf None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:02.213328 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b24f13-ce68-4a14-86ba-d4275504c3cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:02.214103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b24f13-ce68-4a14-86ba-d4275504c3cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:02.215739 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b24f13-ce68-4a14-86ba-d4275504c3cf None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-53b24f13-ce68-4a14-86ba-d4275504c3cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:02.225514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:02.226635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Oct 22 20:32:02.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:02.230536 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 271/545] 10.222.0.39 () {56 vars in 1129 bytes} [Sat Oct 22 20:32:02 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:02.235358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-f69038f1-010e-4433-b18e-5249d9404086 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:02.235358 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-f69038f1-010e-4433-b18e-5249d9404086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:02.236894 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b24f13-ce68-4a14-86ba-d4275504c3cf None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:02.262589 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:02.291900 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:02.309680 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 275/546] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:02 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 20:32:02.362493 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b24f13-ce68-4a14-86ba-d4275504c3cf None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:02.403280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c51f53-2125-4551-81b9-da37b9e5c51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:02.403280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c51f53-2125-4551-81b9-da37b9e5c51a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:02.403280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c51f53-2125-4551-81b9-da37b9e5c51a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:02.403280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c51f53-2125-4551-81b9-da37b9e5c51a None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:02.403650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c51f53-2125-4551-81b9-da37b9e5c51a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:02.403650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c51f53-2125-4551-81b9-da37b9e5c51a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:02.403650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c51f53-2125-4551-81b9-da37b9e5c51a None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:02.406201 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 272/547] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Oct 22 20:32:02 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:02.411952 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69038f1-010e-4433-b18e-5249d9404086 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:02.518537 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69038f1-010e-4433-b18e-5249d9404086 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:02.557401 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ede41fc-aaa3-490f-b2a1-e9b9d806126e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:02.558011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede41fc-aaa3-490f-b2a1-e9b9d806126e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:02.558288 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede41fc-aaa3-490f-b2a1-e9b9d806126e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:02.558561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ede41fc-aaa3-490f-b2a1-e9b9d806126e None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:02.559187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede41fc-aaa3-490f-b2a1-e9b9d806126e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:02.559510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede41fc-aaa3-490f-b2a1-e9b9d806126e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:02.560880 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ede41fc-aaa3-490f-b2a1-e9b9d806126e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:02.566046 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 276/548] 10.222.0.39 () {56 vars in 1124 bytes} [Sat Oct 22 20:32:02 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:02.574079 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c51f53-2125-4551-81b9-da37b9e5c51a None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:02.590891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe62fa3-9961-42e1-a94b-b717185e7012 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:02.591365 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe62fa3-9961-42e1-a94b-b717185e7012 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:02.591758 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe62fa3-9961-42e1-a94b-b717185e7012 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:02.593478 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 277/549] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:02.598462 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ce613-806f-4667-9119-adb9f30fa984 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:02.598807 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ce613-806f-4667-9119-adb9f30fa984 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:02.599086 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912ce613-806f-4667-9119-adb9f30fa984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:02.618338 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-912ce613-806f-4667-9119-adb9f30fa984 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:02.619950 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-912ce613-806f-4667-9119-adb9f30fa984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:02.647490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:02.698815 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c51f53-2125-4551-81b9-da37b9e5c51a None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:02.702189 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 278/550] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:02 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 20:32:02.703182 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ce613-806f-4667-9119-adb9f30fa984 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:02.706320 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:02.748750 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c134f-1439-4750-96ea-f8e56461f8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:02.749648 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c134f-1439-4750-96ea-f8e56461f8ee None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:02.750133 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c134f-1439-4750-96ea-f8e56461f8ee None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:02.750598 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c134f-1439-4750-96ea-f8e56461f8ee None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:02.751469 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c134f-1439-4750-96ea-f8e56461f8ee None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:02.753540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c134f-1439-4750-96ea-f8e56461f8ee None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:02.791853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 273/551] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:32:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:32:02.832616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912ce613-806f-4667-9119-adb9f30fa984 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:02.890720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533ce45-313a-4cfd-8064-2cb4dc9d13f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:02.891316 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533ce45-313a-4cfd-8064-2cb4dc9d13f7 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:02.891650 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533ce45-313a-4cfd-8064-2cb4dc9d13f7 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:02.891925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3533ce45-313a-4cfd-8064-2cb4dc9d13f7 None admin] PATH_INFO: `/v3/services/image` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:02.892516 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533ce45-313a-4cfd-8064-2cb4dc9d13f7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:02.893900 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3533ce45-313a-4cfd-8064-2cb4dc9d13f7 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-3533ce45-313a-4cfd-8064-2cb4dc9d13f7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:02.904526 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:02.905599 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:02.906424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 279/552] 10.222.0.39 () {56 vars in 1105 bytes} [Sat Oct 22 20:32:02 2022] GET /identity/v3/services/image => generated 86 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:02.912087 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c134f-1439-4750-96ea-f8e56461f8ee None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:03.032155 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533ce45-313a-4cfd-8064-2cb4dc9d13f7 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:03.038946 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c134f-1439-4750-96ea-f8e56461f8ee None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:03.059833 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:03.086693 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c36e0-6497-408b-91dd-2693af928806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:03.087693 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c36e0-6497-408b-91dd-2693af928806 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:03.088261 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c36e0-6497-408b-91dd-2693af928806 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:03.088540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340c36e0-6497-408b-91dd-2693af928806 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:03.089206 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c36e0-6497-408b-91dd-2693af928806 None admin] RBAC: Adding query filter params (name=image) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:03.089509 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c36e0-6497-408b-91dd-2693af928806 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:03.091677 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340c36e0-6497-408b-91dd-2693af928806 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:03.101325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 274/553] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:32:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:03.109331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c36e0-6497-408b-91dd-2693af928806 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:03.140339 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:03.156689 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3533ce45-313a-4cfd-8064-2cb4dc9d13f7 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:03.196466 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f7b71-7523-4d66-9289-3d2d5f892b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:03.197107 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f7b71-7523-4d66-9289-3d2d5f892b60 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:03.197383 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f7b71-7523-4d66-9289-3d2d5f892b60 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:03.197653 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155f7b71-7523-4d66-9289-3d2d5f892b60 None admin] PATH_INFO: `/v3/services/network` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:03.198240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f7b71-7523-4d66-9289-3d2d5f892b60 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:03.199711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155f7b71-7523-4d66-9289-3d2d5f892b60 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-155f7b71-7523-4d66-9289-3d2d5f892b60 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:03.210473 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:03.212129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Oct 22 20:32:03.212954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:03.216705 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 280/554] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:32:03 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:32:03.218356 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f7b71-7523-4d66-9289-3d2d5f892b60 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:03.223878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340c36e0-6497-408b-91dd-2693af928806 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:03.260640 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8dbe8-e573-468c-87e8-46a8be79e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:03.261617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8dbe8-e573-468c-87e8-46a8be79e9ff None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:03.262111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8dbe8-e573-468c-87e8-46a8be79e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:03.262594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a8dbe8-e573-468c-87e8-46a8be79e9ff None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:03.263567 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8dbe8-e573-468c-87e8-46a8be79e9ff None admin] RBAC: Adding query filter params (type=image) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:03.264069 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8dbe8-e573-468c-87e8-46a8be79e9ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:03.265756 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a8dbe8-e573-468c-87e8-46a8be79e9ff None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:03.271659 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 275/555] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:32:03 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:03.277354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8dbe8-e573-468c-87e8-46a8be79e9ff None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:03.318293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:03.340352 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155f7b71-7523-4d66-9289-3d2d5f892b60 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:03.380429 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef038359-2ff0-41ba-95ea-222dac55eaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:03.381043 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef038359-2ff0-41ba-95ea-222dac55eaee None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:03.381321 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef038359-2ff0-41ba-95ea-222dac55eaee None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:03.381592 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef038359-2ff0-41ba-95ea-222dac55eaee None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:03.382226 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef038359-2ff0-41ba-95ea-222dac55eaee None admin] RBAC: Adding query filter params (name=network) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:03.382525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef038359-2ff0-41ba-95ea-222dac55eaee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:03.383978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef038359-2ff0-41ba-95ea-222dac55eaee None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:03.389220 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 281/556] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:32:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:03.397940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef038359-2ff0-41ba-95ea-222dac55eaee None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:03.413707 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:03.425104 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a8dbe8-e573-468c-87e8-46a8be79e9ff None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:03.466506 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a50998f-a8dc-4aeb-bf5f-5ddf52a6fe07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:03.467753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50998f-a8dc-4aeb-bf5f-5ddf52a6fe07 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:03.468508 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50998f-a8dc-4aeb-bf5f-5ddf52a6fe07 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:03.468995 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a50998f-a8dc-4aeb-bf5f-5ddf52a6fe07 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:03.470532 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50998f-a8dc-4aeb-bf5f-5ddf52a6fe07 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:03.472777 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a50998f-a8dc-4aeb-bf5f-5ddf52a6fe07 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:03.507949 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 276/557] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:32:03 2022] POST /identity/v3/endpoints => generated 327 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 20:32:03.521204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef038359-2ff0-41ba-95ea-222dac55eaee None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:03.524343 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1e06f-24ae-4b85-850e-4396125e4586 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:03.524630 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1e06f-24ae-4b85-850e-4396125e4586 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:03.524902 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1e06f-24ae-4b85-850e-4396125e4586 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:03.526827 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 277/558] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:03.533315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7cd92-2106-45da-859a-ee88700d19fd None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:03.533694 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7cd92-2106-45da-859a-ee88700d19fd None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:03.534132 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc7cd92-2106-45da-859a-ee88700d19fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:03.554874 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-9dc7cd92-2106-45da-859a-ee88700d19fd None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:03.556115 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-9dc7cd92-2106-45da-859a-ee88700d19fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:03.568168 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dea550-0328-4876-b863-81336058e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:03.568934 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dea550-0328-4876-b863-81336058e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:03.569282 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dea550-0328-4876-b863-81336058e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:03.569616 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dea550-0328-4876-b863-81336058e1c4 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:03.570472 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dea550-0328-4876-b863-81336058e1c4 None admin] RBAC: Adding query filter params (type=network) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:03.570840 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dea550-0328-4876-b863-81336058e1c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:03.572320 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75dea550-0328-4876-b863-81336058e1c4 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:03.579350 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 282/559] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:32:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:03.589885 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dea550-0328-4876-b863-81336058e1c4 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:03.602709 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:03.663969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 278/560] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:03 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Oct 22 20:32:03.716305 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dea550-0328-4876-b863-81336058e1c4 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:03.758126 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795e0907-63d4-4fb6-a908-b554129c6b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:03.759102 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e0907-63d4-4fb6-a908-b554129c6b65 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:03.759625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e0907-63d4-4fb6-a908-b554129c6b65 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:03.760104 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795e0907-63d4-4fb6-a908-b554129c6b65 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:03.760964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e0907-63d4-4fb6-a908-b554129c6b65 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:03.762530 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795e0907-63d4-4fb6-a908-b554129c6b65 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:03.786978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 283/561] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:32:03 2022] POST /identity/v3/endpoints => generated 337 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:32:03.998292 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7cd92-2106-45da-859a-ee88700d19fd None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:04.079898 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:04.110738 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc7cd92-2106-45da-859a-ee88700d19fd None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:04.151848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7408cc0c-0442-40bf-b41a-96f063d0a8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:04.152814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408cc0c-0442-40bf-b41a-96f063d0a8ba None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:04.153315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408cc0c-0442-40bf-b41a-96f063d0a8ba None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:04.153791 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7408cc0c-0442-40bf-b41a-96f063d0a8ba None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:04.154650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408cc0c-0442-40bf-b41a-96f063d0a8ba None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:04.156270 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7408cc0c-0442-40bf-b41a-96f063d0a8ba None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:04.174527 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 279/562] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:32:03 2022] POST /identity/v3/services => generated 269 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:32:05.304492 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b628ef-896a-433d-9e16-bb099e7d2e02 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:05.305051 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b628ef-896a-433d-9e16-bb099e7d2e02 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:05.305051 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b628ef-896a-433d-9e16-bb099e7d2e02 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:05.306360 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 284/563] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:05.312411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4091874-9fc9-441e-ab25-be5206608ff5 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:05.312967 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4091874-9fc9-441e-ab25-be5206608ff5 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:05.312967 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4091874-9fc9-441e-ab25-be5206608ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:05.334114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-d4091874-9fc9-441e-ab25-be5206608ff5 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:05.334114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-d4091874-9fc9-441e-ab25-be5206608ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:05.410932 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 280/564] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:05 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:05.727172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b628ef-896a-433d-9e16-bb099e7d2e02 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:05.791979 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:05.833761 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b628ef-896a-433d-9e16-bb099e7d2e02 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:05.868104 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bebfcc-810e-4c48-84af-2410ff3ab20b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:05.868729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebfcc-810e-4c48-84af-2410ff3ab20b None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:05.868999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebfcc-810e-4c48-84af-2410ff3ab20b None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:05.869268 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bebfcc-810e-4c48-84af-2410ff3ab20b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:05.869811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bebfcc-810e-4c48-84af-2410ff3ab20b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:05.871184 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bebfcc-810e-4c48-84af-2410ff3ab20b None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-54bebfcc-810e-4c48-84af-2410ff3ab20b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:05.879769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:05.880777 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 20:32:05.881583 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:05.883334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 285/565] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:32:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:05.887189 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4091874-9fc9-441e-ab25-be5206608ff5 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:05.946464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:05.991503 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4091874-9fc9-441e-ab25-be5206608ff5 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:05.997073 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab937-3306-4896-b290-d52d010066a8 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:05.997354 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab937-3306-4896-b290-d52d010066a8 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:05.997621 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baab937-3306-4896-b290-d52d010066a8 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:05.999697 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 286/566] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:32:06.003987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200ba1-35c7-4284-af4d-a56b226f40bd None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:06.004266 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200ba1-35c7-4284-af4d-a56b226f40bd None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:06.004559 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29200ba1-35c7-4284-af4d-a56b226f40bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:06.024004 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-29200ba1-35c7-4284-af4d-a56b226f40bd None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:06.025218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-29200ba1-35c7-4284-af4d-a56b226f40bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:06.027092 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccd4ee-1db0-43b0-856f-74bc7bcc1b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:06.027690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd4ee-1db0-43b0-856f-74bc7bcc1b57 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:06.027966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd4ee-1db0-43b0-856f-74bc7bcc1b57 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:06.028832 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ccd4ee-1db0-43b0-856f-74bc7bcc1b57 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:06.029010 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccd4ee-1db0-43b0-856f-74bc7bcc1b57 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:06.029272 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccd4ee-1db0-43b0-856f-74bc7bcc1b57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:06.030643 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ccd4ee-1db0-43b0-856f-74bc7bcc1b57 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:06.040606 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 281/567] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:32:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:06.041791 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccd4ee-1db0-43b0-856f-74bc7bcc1b57 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:06.092973 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 287/568] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:06 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:06.142835 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ccd4ee-1db0-43b0-856f-74bc7bcc1b57 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:06.167436 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:06.183190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85343d76-6a44-43cd-be12-1fa87d1630d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:06.183634 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85343d76-6a44-43cd-be12-1fa87d1630d4 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:06.183954 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85343d76-6a44-43cd-be12-1fa87d1630d4 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:06.184129 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85343d76-6a44-43cd-be12-1fa87d1630d4 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:06.184821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85343d76-6a44-43cd-be12-1fa87d1630d4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:06.185116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85343d76-6a44-43cd-be12-1fa87d1630d4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:06.186554 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85343d76-6a44-43cd-be12-1fa87d1630d4 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:06.195435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 282/569] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:32:06 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:06.415579 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29200ba1-35c7-4284-af4d-a56b226f40bd None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:06.469960 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:06.515176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29200ba1-35c7-4284-af4d-a56b226f40bd None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:06.548980 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:06.549908 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:06.550324 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:06.550730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:06.551586 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:06.553114 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:06.562145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.sql.core [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 20:32:06.562145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 20:32:06.562145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [parameters: {'id': 'fd4d43b2cd0644af944e1760634a7516', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 22 20:32:06.562145 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88407) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application conn.query(q) Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:32:06.569956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application result.read() Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 22 20:32:06.570948 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application next(self.gen) Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application yield resource Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application next(self.gen) Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.session.rollback() Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.force_reraise() Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise self.value Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application session.commit() Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 22 20:32:06.572123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._prepare_impl() Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.session.flush() Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._flush(objects) Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application compat.raise_( Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application flush_context.execute() Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rec.execute(self) Oct 22 20:32:06.573285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 20:32:06.574364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application conn.query(q) Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application result.read() Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 20:32:06.575416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry '<>-Default' for key 'project.ixu_project_name_domain_id'") Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [parameters: {'id': 'fd4d43b2cd0644af944e1760634a7516', 'name': 'Default', 'domain_id': '<>', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': None, 'is_domain': 1}] Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 22 20:32:06.576525 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name Default. Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:06.577510 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 128, in post Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_domain( Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 765, in create_domain Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application is_domain_project = self.create_project( Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects acting as domains with the same name: Default. Oct 22 20:32:06.578569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:06.581045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 288/570] 10.222.0.39 () {60 vars in 1137 bytes} [Sat Oct 22 20:32:06 2022] POST /identity/v3/domains => generated 190 bytes in 166 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:06.584927 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c417d-3950-42f2-8f2b-78f0a9632251 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:06.585594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c417d-3950-42f2-8f2b-78f0a9632251 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:06.585594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550c417d-3950-42f2-8f2b-78f0a9632251 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:06.586688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:06.586991 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 283/571] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:06.592559 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e7fa9-f5ac-434f-a3f1-ecd542993c8e None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:06.592808 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e7fa9-f5ac-434f-a3f1-ecd542993c8e None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:06.593073 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4e7fa9-f5ac-434f-a3f1-ecd542993c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:06.613261 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-0c4e7fa9-f5ac-434f-a3f1-ecd542993c8e None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:06.614558 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-0c4e7fa9-f5ac-434f-a3f1-ecd542993c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:06.691331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 284/572] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:06 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:06.705003 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ed199d-4102-44c3-9fd6-bda63348f286 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:06.730891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:06.746410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43185ce-050b-4b00-a231-0be6c5493bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:06.747298 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43185ce-050b-4b00-a231-0be6c5493bbd None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:06.747804 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43185ce-050b-4b00-a231-0be6c5493bbd None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:06.748264 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43185ce-050b-4b00-a231-0be6c5493bbd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:06.759284 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43185ce-050b-4b00-a231-0be6c5493bbd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:06.760907 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43185ce-050b-4b00-a231-0be6c5493bbd None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-d43185ce-050b-4b00-a231-0be6c5493bbd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:32:06.775250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:06.776254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:32:06.777149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:32:06.777149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:32:06.777149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:06.778664 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 289/573] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:32:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:06.785336 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e7fa9-f5ac-434f-a3f1-ecd542993c8e None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:06.889523 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4e7fa9-f5ac-434f-a3f1-ecd542993c8e None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:06.906730 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:06.926478 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935b7ba-0b9b-4cca-b3a6-f38c25ba1be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:06.927132 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b7ba-0b9b-4cca-b3a6-f38c25ba1be6 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:06.927438 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b7ba-0b9b-4cca-b3a6-f38c25ba1be6 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:06.927705 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2935b7ba-0b9b-4cca-b3a6-f38c25ba1be6 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:06.928333 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935b7ba-0b9b-4cca-b3a6-f38c25ba1be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:06.928625 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935b7ba-0b9b-4cca-b3a6-f38c25ba1be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:06.930106 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2935b7ba-0b9b-4cca-b3a6-f38c25ba1be6 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:06.947387 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 285/574] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:32:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:32:07.024944 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43185ce-050b-4b00-a231-0be6c5493bbd None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:07.134532 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43185ce-050b-4b00-a231-0be6c5493bbd None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:07.170513 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af0e4-58e3-4fd9-997d-60f84c4524af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:07.171123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af0e4-58e3-4fd9-997d-60f84c4524af None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:07.171427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af0e4-58e3-4fd9-997d-60f84c4524af None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:07.171692 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9af0e4-58e3-4fd9-997d-60f84c4524af None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:07.172273 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9af0e4-58e3-4fd9-997d-60f84c4524af None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:07.173636 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9af0e4-58e3-4fd9-997d-60f84c4524af None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-0e9af0e4-58e3-4fd9-997d-60f84c4524af None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:07.182348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:07.183322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:07.184200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 290/575] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Oct 22 20:32:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:07.189591 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935b7ba-0b9b-4cca-b3a6-f38c25ba1be6 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:07.297696 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2935b7ba-0b9b-4cca-b3a6-f38c25ba1be6 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:07.332811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a039-bef0-49c4-930f-430a91c041f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:07.333435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a039-bef0-49c4-930f-430a91c041f0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:07.333706 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a039-bef0-49c4-930f-430a91c041f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:07.333976 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386a039-bef0-49c4-930f-430a91c041f0 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:07.334638 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386a039-bef0-49c4-930f-430a91c041f0 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:07.334939 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386a039-bef0-49c4-930f-430a91c041f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:07.336328 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386a039-bef0-49c4-930f-430a91c041f0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:07.340983 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 286/576] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Oct 22 20:32:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:07.346871 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af0e4-58e3-4fd9-997d-60f84c4524af None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:07.383154 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:07.452488 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9af0e4-58e3-4fd9-997d-60f84c4524af None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:07.487136 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251a56-dc70-47b6-b4ef-267d722afd7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:07.487761 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251a56-dc70-47b6-b4ef-267d722afd7a None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:07.488032 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251a56-dc70-47b6-b4ef-267d722afd7a None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:07.488307 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da251a56-dc70-47b6-b4ef-267d722afd7a None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:07.488925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da251a56-dc70-47b6-b4ef-267d722afd7a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:07.489278 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da251a56-dc70-47b6-b4ef-267d722afd7a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:07.490632 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da251a56-dc70-47b6-b4ef-267d722afd7a None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:07.495533 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 291/577] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Oct 22 20:32:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:07.501321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a039-bef0-49c4-930f-430a91c041f0 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:07.544574 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:07.605006 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386a039-bef0-49c4-930f-430a91c041f0 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:07.640524 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ac5549-9bcb-465f-8469-5815cdf1abee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:07.641272 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac5549-9bcb-465f-8469-5815cdf1abee None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:07.641541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac5549-9bcb-465f-8469-5815cdf1abee None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:07.641806 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ac5549-9bcb-465f-8469-5815cdf1abee None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:07.642485 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac5549-9bcb-465f-8469-5815cdf1abee None admin] RBAC: Adding query filter params (interface=public, service_id=668857f77d1e4370842edeb8b04623ca, region_id=RegionOne) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:07.642785 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac5549-9bcb-465f-8469-5815cdf1abee None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:07.644184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ac5549-9bcb-465f-8469-5815cdf1abee None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:07.654491 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 287/578] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Oct 22 20:32:07 2022] GET /identity/v3/endpoints?service_id=668857f77d1e4370842edeb8b04623ca&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:07.655651 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251a56-dc70-47b6-b4ef-267d722afd7a None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:07.752596 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:07.755846 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da251a56-dc70-47b6-b4ef-267d722afd7a None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:07.789213 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd592a00-89a6-4560-ba2c-ef230bce5ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:07.789803 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd592a00-89a6-4560-ba2c-ef230bce5ede None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:07.790075 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd592a00-89a6-4560-ba2c-ef230bce5ede None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:07.790342 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd592a00-89a6-4560-ba2c-ef230bce5ede None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:07.790938 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd592a00-89a6-4560-ba2c-ef230bce5ede None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:07.792342 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd592a00-89a6-4560-ba2c-ef230bce5ede None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:07.798092 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 292/579] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Oct 22 20:32:07 2022] GET /identity/v3/services => generated 1259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:32:08.559749 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93ef26-dd63-491d-a4f4-6aae851a1d4c None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:08.560009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93ef26-dd63-491d-a4f4-6aae851a1d4c None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:08.560279 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d93ef26-dd63-491d-a4f4-6aae851a1d4c None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:08.561595 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 288/580] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:08.567058 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911cd37-58a2-46cc-839a-ef6eb8f61bea None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:08.567589 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911cd37-58a2-46cc-839a-ef6eb8f61bea None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:08.567757 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8911cd37-58a2-46cc-839a-ef6eb8f61bea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:08.587243 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-8911cd37-58a2-46cc-839a-ef6eb8f61bea None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:08.588483 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-8911cd37-58a2-46cc-839a-ef6eb8f61bea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:08.658896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 293/581] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:08 2022] POST /identity/v3/auth/tokens => generated 1516 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:08.973335 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93ef26-dd63-491d-a4f4-6aae851a1d4c None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:09.078673 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d93ef26-dd63-491d-a4f4-6aae851a1d4c None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:09.081050 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:09.116383 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1beecbf0-f061-4180-819f-72a5ae0a3f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:09.116992 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beecbf0-f061-4180-819f-72a5ae0a3f27 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:09.117270 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beecbf0-f061-4180-819f-72a5ae0a3f27 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:09.117542 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1beecbf0-f061-4180-819f-72a5ae0a3f27 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:09.118191 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beecbf0-f061-4180-819f-72a5ae0a3f27 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:09.119605 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1beecbf0-f061-4180-819f-72a5ae0a3f27 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:09.135637 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 289/582] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:32:08 2022] POST /identity/v3/services => generated 251 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:32:10.160529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd911f55-d871-425b-90c1-dd3a8cc4421c None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:10.161191 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd911f55-d871-425b-90c1-dd3a8cc4421c None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:10.161191 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd911f55-d871-425b-90c1-dd3a8cc4421c None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:10.162443 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 294/583] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:10.167711 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2024-9594-463f-a1a9-de6cbbec3306 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:10.168135 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2024-9594-463f-a1a9-de6cbbec3306 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:10.168232 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bf2024-9594-463f-a1a9-de6cbbec3306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:10.187117 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-23bf2024-9594-463f-a1a9-de6cbbec3306 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:10.188324 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-23bf2024-9594-463f-a1a9-de6cbbec3306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:10.264609 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 290/584] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:10 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:10.585439 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd911f55-d871-425b-90c1-dd3a8cc4421c None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:10.682009 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:10.691218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd911f55-d871-425b-90c1-dd3a8cc4421c None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:10.725674 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8ee48-9b8e-4246-b6df-191585a9f656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:10.726310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8ee48-9b8e-4246-b6df-191585a9f656 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:10.726582 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8ee48-9b8e-4246-b6df-191585a9f656 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:10.726844 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f8ee48-9b8e-4246-b6df-191585a9f656 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:10.727425 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8ee48-9b8e-4246-b6df-191585a9f656 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:10.728801 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f8ee48-9b8e-4246-b6df-191585a9f656 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-e1f8ee48-9b8e-4246-b6df-191585a9f656 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:10.742656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:10.743686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:10.744536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 295/585] 10.222.0.39 () {56 vars in 1132 bytes} [Sat Oct 22 20:32:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:10.749968 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2024-9594-463f-a1a9-de6cbbec3306 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:10.843794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:10.855593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bf2024-9594-463f-a1a9-de6cbbec3306 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:10.889593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16e411-2b60-4214-8c61-2d1f489c6ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:10.890195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16e411-2b60-4214-8c61-2d1f489c6ce9 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:10.890465 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16e411-2b60-4214-8c61-2d1f489c6ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:10.890725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df16e411-2b60-4214-8c61-2d1f489c6ce9 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:10.891361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16e411-2b60-4214-8c61-2d1f489c6ce9 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:10.891670 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16e411-2b60-4214-8c61-2d1f489c6ce9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:10.893035 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df16e411-2b60-4214-8c61-2d1f489c6ce9 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:10.897799 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 291/586] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Oct 22 20:32:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:10.903666 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8ee48-9b8e-4246-b6df-191585a9f656 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:11.003986 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f8ee48-9b8e-4246-b6df-191585a9f656 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:11.038763 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba7bdb4-61b2-4a13-b856-bde46c20f874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:11.039446 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7bdb4-61b2-4a13-b856-bde46c20f874 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:11.039722 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7bdb4-61b2-4a13-b856-bde46c20f874 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:11.039987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba7bdb4-61b2-4a13-b856-bde46c20f874 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:11.040624 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7bdb4-61b2-4a13-b856-bde46c20f874 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:11.041053 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7bdb4-61b2-4a13-b856-bde46c20f874 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:11.042417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba7bdb4-61b2-4a13-b856-bde46c20f874 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:11.047597 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 296/587] 10.222.0.39 () {56 vars in 1126 bytes} [Sat Oct 22 20:32:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:11.053530 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16e411-2b60-4214-8c61-2d1f489c6ce9 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:11.162144 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df16e411-2b60-4214-8c61-2d1f489c6ce9 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:11.196795 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613ae4e-61c8-414d-a689-32ead70f33f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:11.197451 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613ae4e-61c8-414d-a689-32ead70f33f3 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:11.197625 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613ae4e-61c8-414d-a689-32ead70f33f3 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:11.197910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613ae4e-61c8-414d-a689-32ead70f33f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:11.198562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613ae4e-61c8-414d-a689-32ead70f33f3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:11.199959 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613ae4e-61c8-414d-a689-32ead70f33f3 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:11.231306 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 292/588] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:32:11 2022] POST /identity/v3/endpoints => generated 347 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:32:11.518238 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d829f53-80b3-42ef-aceb-463799eb7dc1 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:11.518802 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d829f53-80b3-42ef-aceb-463799eb7dc1 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:11.518802 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d829f53-80b3-42ef-aceb-463799eb7dc1 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:11.520132 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 297/589] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:11.525848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920a462-f398-4993-a0fb-41dbd191734c None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:11.526131 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920a462-f398-4993-a0fb-41dbd191734c None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:11.526400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f920a462-f398-4993-a0fb-41dbd191734c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:11.545889 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-f920a462-f398-4993-a0fb-41dbd191734c None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:11.547071 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-f920a462-f398-4993-a0fb-41dbd191734c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:11.550032 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:11.620909 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 293/590] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:11 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:11.939988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d829f53-80b3-42ef-aceb-463799eb7dc1 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:11.965240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:12.042529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d829f53-80b3-42ef-aceb-463799eb7dc1 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:12.076236 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd39f4-9277-4a01-a6c0-24796b9ed431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:12.076835 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd39f4-9277-4a01-a6c0-24796b9ed431 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:12.077120 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd39f4-9277-4a01-a6c0-24796b9ed431 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:12.077380 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadd39f4-9277-4a01-a6c0-24796b9ed431 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:12.077949 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd39f4-9277-4a01-a6c0-24796b9ed431 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:12.079294 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadd39f4-9277-4a01-a6c0-24796b9ed431 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-fadd39f4-9277-4a01-a6c0-24796b9ed431 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:12.087953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:12.091484 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:12.092520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 298/591] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:32:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:12.095038 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920a462-f398-4993-a0fb-41dbd191734c None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:12.194373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f920a462-f398-4993-a0fb-41dbd191734c None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:12.228407 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054db51-070b-4465-afd8-f0c806e5a9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:12.229299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054db51-070b-4465-afd8-f0c806e5a9eb None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:12.229553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054db51-070b-4465-afd8-f0c806e5a9eb None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:12.229809 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6054db51-070b-4465-afd8-f0c806e5a9eb None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:12.230418 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054db51-070b-4465-afd8-f0c806e5a9eb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:12.230710 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054db51-070b-4465-afd8-f0c806e5a9eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:12.232160 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6054db51-070b-4465-afd8-f0c806e5a9eb None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:12.233880 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:12.237329 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 294/592] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:32:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:32:12.243147 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd39f4-9277-4a01-a6c0-24796b9ed431 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:12.325667 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:12.342422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadd39f4-9277-4a01-a6c0-24796b9ed431 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:12.376565 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5af6f-6723-49cc-af99-d27d8400a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:12.377158 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5af6f-6723-49cc-af99-d27d8400a250 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:12.377427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5af6f-6723-49cc-af99-d27d8400a250 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:12.377694 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b5af6f-6723-49cc-af99-d27d8400a250 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:12.378319 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5af6f-6723-49cc-af99-d27d8400a250 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:12.378612 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5af6f-6723-49cc-af99-d27d8400a250 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:12.380049 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b5af6f-6723-49cc-af99-d27d8400a250 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:12.384848 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 299/593] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:32:12 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:12.390874 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054db51-070b-4465-afd8-f0c806e5a9eb None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:12.495667 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6054db51-070b-4465-afd8-f0c806e5a9eb None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:12.529972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b359d52-7781-409c-85df-563c1609c5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:12.530569 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b359d52-7781-409c-85df-563c1609c5d1 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:12.530827 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b359d52-7781-409c-85df-563c1609c5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:12.531085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b359d52-7781-409c-85df-563c1609c5d1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:12.531799 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b359d52-7781-409c-85df-563c1609c5d1 None admin] RBAC: Adding query filter params (interface=public, service_id=9686e8ab25a34f12aa74a9a28abdc00d, region_id=RegionOne) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:12.532098 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b359d52-7781-409c-85df-563c1609c5d1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:12.533447 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b359d52-7781-409c-85df-563c1609c5d1 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:12.538548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 295/594] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Oct 22 20:32:12 2022] GET /identity/v3/endpoints?service_id=9686e8ab25a34f12aa74a9a28abdc00d&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:12.544387 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5af6f-6723-49cc-af99-d27d8400a250 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:12.645752 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b5af6f-6723-49cc-af99-d27d8400a250 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:12.680309 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59fe983-32aa-46d0-89c4-1ed0101f8f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:12.680904 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fe983-32aa-46d0-89c4-1ed0101f8f44 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:12.681174 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fe983-32aa-46d0-89c4-1ed0101f8f44 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:12.681435 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59fe983-32aa-46d0-89c4-1ed0101f8f44 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:12.682277 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fe983-32aa-46d0-89c4-1ed0101f8f44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:12.683399 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59fe983-32aa-46d0-89c4-1ed0101f8f44 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:12.708257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 300/595] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Oct 22 20:32:12 2022] GET /identity/v3/services => generated 1498 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:32:13.612484 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bd46e-d23d-4f58-bd19-51ed5066e57b None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:13.613027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bd46e-d23d-4f58-bd19-51ed5066e57b None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:13.613027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99bd46e-d23d-4f58-bd19-51ed5066e57b None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:13.614425 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 296/596] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:13.619882 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace205c6-daa1-409b-b6b0-20afe3a91086 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:13.620324 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace205c6-daa1-409b-b6b0-20afe3a91086 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:13.620538 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace205c6-daa1-409b-b6b0-20afe3a91086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:13.639459 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-ace205c6-daa1-409b-b6b0-20afe3a91086 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:13.640631 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-ace205c6-daa1-409b-b6b0-20afe3a91086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:13.649877 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:13.708947 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 301/597] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:13 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:14.025061 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bd46e-d23d-4f58-bd19-51ed5066e57b None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:14.089586 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:14.130250 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99bd46e-d23d-4f58-bd19-51ed5066e57b None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:14.164660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d420ea8-9e8b-4fcb-90fd-38cacdb0242b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:14.165265 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d420ea8-9e8b-4fcb-90fd-38cacdb0242b None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:14.165538 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d420ea8-9e8b-4fcb-90fd-38cacdb0242b None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:14.165803 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d420ea8-9e8b-4fcb-90fd-38cacdb0242b None admin] PATH_INFO: `/v3/services/compute` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:14.166375 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d420ea8-9e8b-4fcb-90fd-38cacdb0242b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:14.167784 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d420ea8-9e8b-4fcb-90fd-38cacdb0242b None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-3d420ea8-9e8b-4fcb-90fd-38cacdb0242b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:14.176581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:14.177709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 20:32:14.178718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:14.182545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 297/598] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:32:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:14.184002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace205c6-daa1-409b-b6b0-20afe3a91086 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:14.280409 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace205c6-daa1-409b-b6b0-20afe3a91086 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:14.316258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4568c03-7347-4d89-9b8d-ffc89a424130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:14.316861 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568c03-7347-4d89-9b8d-ffc89a424130 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:14.317136 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568c03-7347-4d89-9b8d-ffc89a424130 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:14.317398 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4568c03-7347-4d89-9b8d-ffc89a424130 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:14.318009 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568c03-7347-4d89-9b8d-ffc89a424130 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:14.318303 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568c03-7347-4d89-9b8d-ffc89a424130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:14.319684 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4568c03-7347-4d89-9b8d-ffc89a424130 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:14.324444 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 302/599] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:32:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:14.330191 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d420ea8-9e8b-4fcb-90fd-38cacdb0242b None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:14.433871 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d420ea8-9e8b-4fcb-90fd-38cacdb0242b None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:14.460492 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:14.469355 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f269df45-9027-430e-8a58-f6a372664979 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:14.469950 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269df45-9027-430e-8a58-f6a372664979 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:14.470228 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269df45-9027-430e-8a58-f6a372664979 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:14.470497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f269df45-9027-430e-8a58-f6a372664979 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:14.471120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269df45-9027-430e-8a58-f6a372664979 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:14.471440 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269df45-9027-430e-8a58-f6a372664979 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:14.472818 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f269df45-9027-430e-8a58-f6a372664979 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:14.478714 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 298/600] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:32:14 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:15.073997 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca2bdf-2e9b-4706-84c6-6044e5409f5b None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:15.074524 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca2bdf-2e9b-4706-84c6-6044e5409f5b None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:15.074524 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca2bdf-2e9b-4706-84c6-6044e5409f5b None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:15.075878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 303/601] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:15.081399 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ada4a4-a85f-4295-bfbf-718ff14a7530 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:15.081814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ada4a4-a85f-4295-bfbf-718ff14a7530 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:15.081969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ada4a4-a85f-4295-bfbf-718ff14a7530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:15.101042 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-d9ada4a4-a85f-4295-bfbf-718ff14a7530 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:15.102282 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-d9ada4a4-a85f-4295-bfbf-718ff14a7530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:15.171139 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 299/602] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:15 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:15.489663 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca2bdf-2e9b-4706-84c6-6044e5409f5b None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:15.500869 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:15.594447 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca2bdf-2e9b-4706-84c6-6044e5409f5b None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:15.629707 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b9892-96e2-4b0e-a78a-2c5cd6e346bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:15.630322 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9892-96e2-4b0e-a78a-2c5cd6e346bc None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:15.630597 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9892-96e2-4b0e-a78a-2c5cd6e346bc None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:15.630845 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2b9892-96e2-4b0e-a78a-2c5cd6e346bc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:15.631451 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b9892-96e2-4b0e-a78a-2c5cd6e346bc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:15.632804 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2b9892-96e2-4b0e-a78a-2c5cd6e346bc None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-3e2b9892-96e2-4b0e-a78a-2c5cd6e346bc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:15.641410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:15.642375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:15.643212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 304/603] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:32:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:15.648871 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ada4a4-a85f-4295-bfbf-718ff14a7530 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:15.757329 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ada4a4-a85f-4295-bfbf-718ff14a7530 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:15.781087 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:15.793066 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381027a1-5189-498f-9f6e-5e73fd508799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:15.793666 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381027a1-5189-498f-9f6e-5e73fd508799 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:15.793939 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381027a1-5189-498f-9f6e-5e73fd508799 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:15.794199 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381027a1-5189-498f-9f6e-5e73fd508799 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:15.794815 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381027a1-5189-498f-9f6e-5e73fd508799 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:15.795106 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381027a1-5189-498f-9f6e-5e73fd508799 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:15.796507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381027a1-5189-498f-9f6e-5e73fd508799 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:15.801047 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 300/604] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:32:15 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:15.806821 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b9892-96e2-4b0e-a78a-2c5cd6e346bc None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:15.876488 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:15.906830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2b9892-96e2-4b0e-a78a-2c5cd6e346bc None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:15.939633 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6bcf3a9-d345-496f-80a6-0fd3ac16cbd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:15.940223 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcf3a9-d345-496f-80a6-0fd3ac16cbd9 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:15.940491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcf3a9-d345-496f-80a6-0fd3ac16cbd9 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:15.940896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6bcf3a9-d345-496f-80a6-0fd3ac16cbd9 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:15.941512 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcf3a9-d345-496f-80a6-0fd3ac16cbd9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:15.941806 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcf3a9-d345-496f-80a6-0fd3ac16cbd9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:15.943175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6bcf3a9-d345-496f-80a6-0fd3ac16cbd9 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:15.947833 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 305/605] 10.222.0.39 () {56 vars in 1114 bytes} [Sat Oct 22 20:32:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:15.953677 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381027a1-5189-498f-9f6e-5e73fd508799 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:16.056090 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381027a1-5189-498f-9f6e-5e73fd508799 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:16.090310 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7081bf8-577a-4de8-bfa0-bcb3ac92adeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:16.090924 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7081bf8-577a-4de8-bfa0-bcb3ac92adeb None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:16.091154 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7081bf8-577a-4de8-bfa0-bcb3ac92adeb None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:16.091525 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7081bf8-577a-4de8-bfa0-bcb3ac92adeb None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:16.092184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7081bf8-577a-4de8-bfa0-bcb3ac92adeb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:16.093546 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7081bf8-577a-4de8-bfa0-bcb3ac92adeb None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:16.114468 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 301/606] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:32:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:32:16.849360 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c155-a7a8-42e7-9666-af8c84ca4fbb None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:16.849899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c155-a7a8-42e7-9666-af8c84ca4fbb None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:16.849899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f35c155-a7a8-42e7-9666-af8c84ca4fbb None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:16.851210 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 306/607] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:16.856839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84bc17-5551-4873-a09c-cbedc1d6ab2c None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:16.857146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84bc17-5551-4873-a09c-cbedc1d6ab2c None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:16.857412 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84bc17-5551-4873-a09c-cbedc1d6ab2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:16.875767 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-fc84bc17-5551-4873-a09c-cbedc1d6ab2c None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:16.876931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-fc84bc17-5551-4873-a09c-cbedc1d6ab2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:16.913387 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:16.950890 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 302/608] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:16 2022] POST /identity/v3/auth/tokens => generated 1617 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:17.264076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c155-a7a8-42e7-9666-af8c84ca4fbb None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:17.366173 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f35c155-a7a8-42e7-9666-af8c84ca4fbb None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:17.402802 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b7682f-4924-4793-b3a6-5545f74c6f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:17.403454 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7682f-4924-4793-b3a6-5545f74c6f93 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:17.403726 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7682f-4924-4793-b3a6-5545f74c6f93 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:17.403991 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b7682f-4924-4793-b3a6-5545f74c6f93 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:17.404629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7682f-4924-4793-b3a6-5545f74c6f93 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:17.405977 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b7682f-4924-4793-b3a6-5545f74c6f93 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:17.410268 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:17.422279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 307/609] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:32:17 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:32:18.502022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3747591-5618-4a5f-9bd6-77ae9b44db72 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:18.502548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3747591-5618-4a5f-9bd6-77ae9b44db72 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:18.502548 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3747591-5618-4a5f-9bd6-77ae9b44db72 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:18.503956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 303/610] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:18.510921 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe740f-a51f-4871-8e8b-371f2fcd4075 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:18.511368 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe740f-a51f-4871-8e8b-371f2fcd4075 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:18.511509 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fe740f-a51f-4871-8e8b-371f2fcd4075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:18.530842 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-61fe740f-a51f-4871-8e8b-371f2fcd4075 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:18.532060 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-61fe740f-a51f-4871-8e8b-371f2fcd4075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:18.606318 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 308/611] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:18 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:18.919362 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3747591-5618-4a5f-9bd6-77ae9b44db72 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:19.024479 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3747591-5618-4a5f-9bd6-77ae9b44db72 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:19.060174 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:19.060766 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:19.061037 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:19.061304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:19.061933 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:19.063402 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:19.066029 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING keystone.server.flask.common [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Oct 22 20:32:19.083896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.sql.core [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 22 20:32:19.083896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 20:32:19.083896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [parameters: {'id': 'd52543c0c4e542548fd511ff4419e184', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 22 20:32:19.083896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d52543c0c4e542548fd511ff4419e184.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d52543c0c4e542548fd511ff4419e184. Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application conn.query(q) Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:32:19.100435 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application result.read() Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Oct 22 20:32:19.101414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return project_ref.to_dict() Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application next(self.gen) Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application yield resource Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application next(self.gen) Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.session.rollback() Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.force_reraise() Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise self.value Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application session.commit() Oct 22 20:32:19.102497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._prepare_impl() Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.session.flush() Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._flush(objects) Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application compat.raise_( Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application flush_context.execute() Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 20:32:19.103602 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rec.execute(self) Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application c = connection._execute_20( Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 22 20:32:19.104789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application conn.query(q) Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application result.read() Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:32:19.105545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [parameters: {'id': 'd52543c0c4e542548fd511ff4419e184', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:19.106400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:19.108151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.Conflict( Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id d52543c0c4e542548fd511ff4419e184. Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:19.109231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 304/612] 10.222.0.39 () {60 vars in 1140 bytes} [Sat Oct 22 20:32:18 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:19.109896 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe740f-a51f-4871-8e8b-371f2fcd4075 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:19.212228 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fe740f-a51f-4871-8e8b-371f2fcd4075 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:19.234022 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:19.245972 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5e7dd8-2633-4f97-9db5-f992b528d720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:19.246601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e7dd8-2633-4f97-9db5-f992b528d720 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:19.246875 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e7dd8-2633-4f97-9db5-f992b528d720 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:19.247142 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5e7dd8-2633-4f97-9db5-f992b528d720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:19.253697 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e7dd8-2633-4f97-9db5-f992b528d720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:19.255177 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5e7dd8-2633-4f97-9db5-f992b528d720 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-4f5e7dd8-2633-4f97-9db5-f992b528d720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:32:19.266083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:19.266964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:19.267940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:32:19.267940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:32:19.267940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:32:19.267940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:32:19.267940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:32:19.267940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:32:19.267940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:32:19.267940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:19.267940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 309/613] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:32:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:32:19.273720 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:19.302528 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:19.386991 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e2c95c-c45b-4c97-a58d-65bc58320735 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:19.421734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e885b42-0d1d-4f9c-987c-1cb9a29564f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:19.422336 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885b42-0d1d-4f9c-987c-1cb9a29564f0 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:19.422611 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885b42-0d1d-4f9c-987c-1cb9a29564f0 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:19.422876 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e885b42-0d1d-4f9c-987c-1cb9a29564f0 None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:19.423562 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885b42-0d1d-4f9c-987c-1cb9a29564f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:19.423858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885b42-0d1d-4f9c-987c-1cb9a29564f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:19.425498 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e885b42-0d1d-4f9c-987c-1cb9a29564f0 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:19.445201 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 305/614] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:32:19 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:19.781913 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c7e42-d465-4ee5-ac9a-da735fad6654 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:19.782502 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c7e42-d465-4ee5-ac9a-da735fad6654 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:19.782502 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016c7e42-d465-4ee5-ac9a-da735fad6654 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:19.783792 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 310/615] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:19.789291 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a154ad-f93b-46e7-9f5c-4834243aa496 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:19.789708 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a154ad-f93b-46e7-9f5c-4834243aa496 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:19.789813 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a154ad-f93b-46e7-9f5c-4834243aa496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:19.811190 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-a6a154ad-f93b-46e7-9f5c-4834243aa496 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:19.812725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-a6a154ad-f93b-46e7-9f5c-4834243aa496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:19.882085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 306/616] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:19 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:20.195126 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c7e42-d465-4ee5-ac9a-da735fad6654 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:20.299663 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016c7e42-d465-4ee5-ac9a-da735fad6654 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:20.334581 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41451c7a-614d-4ac9-98f6-c2d180bb84f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:20.335203 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41451c7a-614d-4ac9-98f6-c2d180bb84f8 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:20.335501 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41451c7a-614d-4ac9-98f6-c2d180bb84f8 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:20.335755 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41451c7a-614d-4ac9-98f6-c2d180bb84f8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:20.336332 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41451c7a-614d-4ac9-98f6-c2d180bb84f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:20.337691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41451c7a-614d-4ac9-98f6-c2d180bb84f8 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-41451c7a-614d-4ac9-98f6-c2d180bb84f8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:20.346353 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:20.347577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:20.348417 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 311/617] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:32:20 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:20.353595 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a154ad-f93b-46e7-9f5c-4834243aa496 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:20.369161 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:20.455812 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a154ad-f93b-46e7-9f5c-4834243aa496 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:20.491049 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423a2d0-2517-4a67-b8bb-f14ba349491d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:20.491669 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423a2d0-2517-4a67-b8bb-f14ba349491d None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:20.491942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423a2d0-2517-4a67-b8bb-f14ba349491d None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:20.492202 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4423a2d0-2517-4a67-b8bb-f14ba349491d None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:20.492817 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423a2d0-2517-4a67-b8bb-f14ba349491d None admin] RBAC: Adding query filter params (name=compute) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:20.493108 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423a2d0-2517-4a67-b8bb-f14ba349491d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:20.494464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4423a2d0-2517-4a67-b8bb-f14ba349491d None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:20.499285 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 307/618] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:32:20 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:20.505181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41451c7a-614d-4ac9-98f6-c2d180bb84f8 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:20.553053 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:20.607450 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41451c7a-614d-4ac9-98f6-c2d180bb84f8 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:20.640174 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea7deb-4101-4de5-be5d-f0652aff4eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:20.640783 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea7deb-4101-4de5-be5d-f0652aff4eb3 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:20.641061 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea7deb-4101-4de5-be5d-f0652aff4eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:20.641333 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ea7deb-4101-4de5-be5d-f0652aff4eb3 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:20.641952 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea7deb-4101-4de5-be5d-f0652aff4eb3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:20.642246 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea7deb-4101-4de5-be5d-f0652aff4eb3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:20.643625 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ea7deb-4101-4de5-be5d-f0652aff4eb3 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:20.648482 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 312/619] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:32:20 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:20.654719 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423a2d0-2517-4a67-b8bb-f14ba349491d None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:20.733581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:20.757580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4423a2d0-2517-4a67-b8bb-f14ba349491d None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:20.791500 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd165b-8e8c-4f37-b45a-3e84522566ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:20.792278 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd165b-8e8c-4f37-b45a-3e84522566ed None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:20.792743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd165b-8e8c-4f37-b45a-3e84522566ed None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:20.793195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd165b-8e8c-4f37-b45a-3e84522566ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:20.794015 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd165b-8e8c-4f37-b45a-3e84522566ed None admin] RBAC: Adding query filter params (interface=public, service_id=a0247c4e7c814ae2889b2b22ae72d9b0, region_id=RegionOne) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:20.794321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd165b-8e8c-4f37-b45a-3e84522566ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:20.795714 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcd165b-8e8c-4f37-b45a-3e84522566ed None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:20.801693 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 308/620] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Oct 22 20:32:20 2022] GET /identity/v3/endpoints?service_id=a0247c4e7c814ae2889b2b22ae72d9b0&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:20.807575 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea7deb-4101-4de5-be5d-f0652aff4eb3 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:20.910985 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ea7deb-4101-4de5-be5d-f0652aff4eb3 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:20.921175 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:20.944964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f24554-25f6-4c30-8ec2-0ad23e645029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:20.945563 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24554-25f6-4c30-8ec2-0ad23e645029 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:20.945838 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24554-25f6-4c30-8ec2-0ad23e645029 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:20.946109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f24554-25f6-4c30-8ec2-0ad23e645029 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:20.946704 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f24554-25f6-4c30-8ec2-0ad23e645029 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:20.948093 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f24554-25f6-4c30-8ec2-0ad23e645029 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:20.954206 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 313/621] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Oct 22 20:32:20 2022] GET /identity/v3/services => generated 1728 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:32:21.849848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35adda-d124-4cf9-bc3b-60c4ca899b5d None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:21.850412 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35adda-d124-4cf9-bc3b-60c4ca899b5d None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:21.850412 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea35adda-d124-4cf9-bc3b-60c4ca899b5d None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:21.851854 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 309/622] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:21.857489 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8bfb8-15d4-492b-a151-180e08b7c476 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:21.857923 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8bfb8-15d4-492b-a151-180e08b7c476 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:21.858035 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe8bfb8-15d4-492b-a151-180e08b7c476 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:21.876292 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-afe8bfb8-15d4-492b-a151-180e08b7c476 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:21.877440 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-afe8bfb8-15d4-492b-a151-180e08b7c476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:21.946002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 314/623] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:21 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:22.262140 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35adda-d124-4cf9-bc3b-60c4ca899b5d None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:22.366308 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea35adda-d124-4cf9-bc3b-60c4ca899b5d None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:22.403514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:22.403667 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:22.403954 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:22.404182 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:22.404835 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:22.406269 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:22.421652 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.sql.core [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 22 20:32:22.421652 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 22 20:32:22.421652 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [parameters: {'user_id': '20fdbe17f9a6401981ea5391209f981d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 22 20:32:22.421652 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=88408) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application conn.query(q) Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application result.read() Oct 22 20:32:22.428009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return method(*args, **kwargs) Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 20:32:22.428931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application next(self.gen) Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1068, in _transaction_scope Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application yield resource Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application next(self.gen) Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 670, in _session Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.session.rollback() Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.force_reraise() Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise self.value Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 667, in _session Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 695, in _end_session_transaction Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application session.commit() Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Oct 22 20:32:22.430055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._prepare_impl() Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.session.flush() Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._flush(objects) Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application compat.raise_( Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application flush_context.execute() Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rec.execute(self) Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Oct 22 20:32:22.431102 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application _emit_insert_statements( Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application result = connection._execute_20( Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ret = self._execute_context( Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Oct 22 20:32:22.432086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self.dialect.do_execute( Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application result = self._query(query) Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application conn.query(q) Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application result.read() Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Oct 22 20:32:22.432910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application packet.raise_for_error() Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [parameters: {'user_id': '20fdbe17f9a6401981ea5391209f981d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:22.433725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Oct 22 20:32:22.435056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Oct 22 20:32:22.436218 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Oct 22 20:32:22.436218 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Oct 22 20:32:22.436218 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Oct 22 20:32:22.436218 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Oct 22 20:32:22.436218 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Oct 22 20:32:22.436218 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:32:22.436218 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 310/624] 10.222.0.39 () {60 vars in 1131 bytes} [Sat Oct 22 20:32:22 2022] POST /identity/v3/users => generated 160 bytes in 168 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:22.436735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8bfb8-15d4-492b-a151-180e08b7c476 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:22.530736 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe8bfb8-15d4-492b-a151-180e08b7c476 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:22.532951 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:22.571320 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112ef052-15b1-4fed-8250-5b8543b40079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:22.572285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ef052-15b1-4fed-8250-5b8543b40079 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:22.572545 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ef052-15b1-4fed-8250-5b8543b40079 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:22.572844 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112ef052-15b1-4fed-8250-5b8543b40079 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:22.579881 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ef052-15b1-4fed-8250-5b8543b40079 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:22.581328 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112ef052-15b1-4fed-8250-5b8543b40079 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-112ef052-15b1-4fed-8250-5b8543b40079 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:32:22.592441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:22.598310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:22.599393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 315/625] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:32:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:22.599978 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:22.604879 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:22.703627 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1fe593-f5ea-4cc0-a6d6-3ecf13cef90f None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:22.739048 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a441dc7e-05c6-488e-9aba-76b1be36b15f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:22.739665 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441dc7e-05c6-488e-9aba-76b1be36b15f None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:22.739940 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441dc7e-05c6-488e-9aba-76b1be36b15f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:22.740204 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a441dc7e-05c6-488e-9aba-76b1be36b15f None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:22.740891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441dc7e-05c6-488e-9aba-76b1be36b15f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:22.741187 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441dc7e-05c6-488e-9aba-76b1be36b15f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:22.742813 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a441dc7e-05c6-488e-9aba-76b1be36b15f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:22.780527 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 311/626] 10.222.0.39 () {56 vars in 1101 bytes} [Sat Oct 22 20:32:22 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:23.301619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9058e84-7ead-4d29-ba41-f8a08ea7f54a None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:23.302460 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9058e84-7ead-4d29-ba41-f8a08ea7f54a None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:23.302460 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9058e84-7ead-4d29-ba41-f8a08ea7f54a None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:23.304671 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 316/627] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:32:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:32:23.311007 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70100332-e77b-43c7-87cf-b7f7b75993d5 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:23.311774 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70100332-e77b-43c7-87cf-b7f7b75993d5 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:23.311917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70100332-e77b-43c7-87cf-b7f7b75993d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:23.339511 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-70100332-e77b-43c7-87cf-b7f7b75993d5 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:32:23.341025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-70100332-e77b-43c7-87cf-b7f7b75993d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:32:23.403605 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:23.414768 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 312/628] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:32:23 2022] POST /identity/v3/auth/tokens => generated 1713 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:32:23.731205 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9058e84-7ead-4d29-ba41-f8a08ea7f54a None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:23.843786 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9058e84-7ead-4d29-ba41-f8a08ea7f54a None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:23.878675 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf3e5a-45d0-4f46-922d-e67f28e66828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:23.879361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf3e5a-45d0-4f46-922d-e67f28e66828 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:23.879664 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf3e5a-45d0-4f46-922d-e67f28e66828 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:23.879929 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcf3e5a-45d0-4f46-922d-e67f28e66828 None admin] PATH_INFO: `/v3/services/compute` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:23.880493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf3e5a-45d0-4f46-922d-e67f28e66828 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:23.881836 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcf3e5a-45d0-4f46-922d-e67f28e66828 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-6dcf3e5a-45d0-4f46-922d-e67f28e66828 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:32:23.891029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:32:23.892130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:32:23.893066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 317/629] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:32:23 2022] GET /identity/v3/services/compute => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:32:23.898411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70100332-e77b-43c7-87cf-b7f7b75993d5 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:24.004203 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70100332-e77b-43c7-87cf-b7f7b75993d5 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:24.039012 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534d88b-c19d-4ccf-8821-b2fd96c89414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:24.039634 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534d88b-c19d-4ccf-8821-b2fd96c89414 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:24.039908 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534d88b-c19d-4ccf-8821-b2fd96c89414 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:24.040174 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3534d88b-c19d-4ccf-8821-b2fd96c89414 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:24.040797 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534d88b-c19d-4ccf-8821-b2fd96c89414 None admin] RBAC: Adding query filter params (name=compute) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:24.041087 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534d88b-c19d-4ccf-8821-b2fd96c89414 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:24.042455 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3534d88b-c19d-4ccf-8821-b2fd96c89414 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:24.047287 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 313/630] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:32:23 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:24.053442 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf3e5a-45d0-4f46-922d-e67f28e66828 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:24.082216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:24.152253 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcf3e5a-45d0-4f46-922d-e67f28e66828 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:24.186726 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347ea16-1a2a-4bc4-a6ff-7f4d5533d4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:24.187307 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347ea16-1a2a-4bc4-a6ff-7f4d5533d4db None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:24.187582 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347ea16-1a2a-4bc4-a6ff-7f4d5533d4db None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:24.187849 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347ea16-1a2a-4bc4-a6ff-7f4d5533d4db None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:24.188466 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347ea16-1a2a-4bc4-a6ff-7f4d5533d4db None admin] RBAC: Adding query filter params (type=compute) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:32:24.188758 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347ea16-1a2a-4bc4-a6ff-7f4d5533d4db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:24.190110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347ea16-1a2a-4bc4-a6ff-7f4d5533d4db None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:24.194919 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 318/631] 10.222.0.39 () {56 vars in 1112 bytes} [Sat Oct 22 20:32:24 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:32:24.200898 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534d88b-c19d-4ccf-8821-b2fd96c89414 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:32:24.259247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:24.307097 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3534d88b-c19d-4ccf-8821-b2fd96c89414 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:32:24.344512 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257f50f-a21c-4f02-b13e-3c63574071d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:32:24.345116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257f50f-a21c-4f02-b13e-3c63574071d7 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:32:24.345347 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257f50f-a21c-4f02-b13e-3c63574071d7 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:32:24.345607 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257f50f-a21c-4f02-b13e-3c63574071d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:32:24.346248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257f50f-a21c-4f02-b13e-3c63574071d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:32:24.347633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3257f50f-a21c-4f02-b13e-3c63574071d7 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:32:24.371069 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 314/632] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:32:24 2022] POST /identity/v3/endpoints => generated 334 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:32:34.192482 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=54 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:32:34.366787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=43,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:27.000389 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ac4e4-0709-4784-b933-9c03536ee661 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:27.001035 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ac4e4-0709-4784-b933-9c03536ee661 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:27.001035 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9ac4e4-0709-4784-b933-9c03536ee661 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:27.002249 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 319/633] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:33:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:33:27.009547 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d0186-7f73-4e26-9111-2219546d8bb6 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:27.010066 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d0186-7f73-4e26-9111-2219546d8bb6 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:27.010226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546d0186-7f73-4e26-9111-2219546d8bb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:27.032442 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-546d0186-7f73-4e26-9111-2219546d8bb6 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:33:27.033759 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-546d0186-7f73-4e26-9111-2219546d8bb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:33:27.118247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 315/634] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:33:27 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:33:27.500982 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ac4e4-0709-4784-b933-9c03536ee661 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:27.620494 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9ac4e4-0709-4784-b933-9c03536ee661 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:27.660085 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d830aa4-d711-4562-a395-1b0dc05354c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:27.660665 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830aa4-d711-4562-a395-1b0dc05354c7 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:27.660935 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830aa4-d711-4562-a395-1b0dc05354c7 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:27.661196 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d830aa4-d711-4562-a395-1b0dc05354c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:27.674456 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d830aa4-d711-4562-a395-1b0dc05354c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:27.676064 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d830aa4-d711-4562-a395-1b0dc05354c7 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-2d830aa4-d711-4562-a395-1b0dc05354c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:33:27.693819 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:27.695131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:33:27.696285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:33:27.696285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:27.696285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:27.696285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 320/635] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:27.701624 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d0186-7f73-4e26-9111-2219546d8bb6 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:27.825972 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546d0186-7f73-4e26-9111-2219546d8bb6 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:27.865910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:27.876208 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a23b-cfbc-4733-8daf-2f9d3b661a5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:27.877186 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a23b-cfbc-4733-8daf-2f9d3b661a5a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:27.878166 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a23b-cfbc-4733-8daf-2f9d3b661a5a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:27.878520 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a23b-cfbc-4733-8daf-2f9d3b661a5a None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:27.879214 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993a23b-cfbc-4733-8daf-2f9d3b661a5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:27.879632 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993a23b-cfbc-4733-8daf-2f9d3b661a5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:27.881753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993a23b-cfbc-4733-8daf-2f9d3b661a5a None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:27.899085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 316/636] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:33:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:27.900648 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d830aa4-d711-4562-a395-1b0dc05354c7 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:27.965657 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:28.024053 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d830aa4-d711-4562-a395-1b0dc05354c7 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:28.063050 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b9f6bb-6002-458f-b6ef-33be382baba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:28.063909 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9f6bb-6002-458f-b6ef-33be382baba2 None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:28.064251 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9f6bb-6002-458f-b6ef-33be382baba2 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:28.064602 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b9f6bb-6002-458f-b6ef-33be382baba2 None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:28.065427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9f6bb-6002-458f-b6ef-33be382baba2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:28.067105 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b9f6bb-6002-458f-b6ef-33be382baba2 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:28.091198 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 321/637] 10.222.0.39 () {60 vars in 1132 bytes} [Sat Oct 22 20:33:27 2022] POST /identity/v3/users => generated 251 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:33:30.512721 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af744c-7390-4c5d-bf21-82d75fc43605 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:30.513348 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af744c-7390-4c5d-bf21-82d75fc43605 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:30.513348 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79af744c-7390-4c5d-bf21-82d75fc43605 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:30.514656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 317/638] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:33:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:33:30.520981 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f8cf4-e0ea-4cce-b951-78b5733f0e54 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:30.520981 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f8cf4-e0ea-4cce-b951-78b5733f0e54 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:30.521814 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f8cf4-e0ea-4cce-b951-78b5733f0e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:30.544718 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-158f8cf4-e0ea-4cce-b951-78b5733f0e54 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:33:30.546131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-158f8cf4-e0ea-4cce-b951-78b5733f0e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:33:30.612208 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 322/639] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:33:30 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:33:30.968206 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af744c-7390-4c5d-bf21-82d75fc43605 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:31.084622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79af744c-7390-4c5d-bf21-82d75fc43605 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:31.121839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f39ef-1f3c-4f78-bc1d-3748dbb95299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:31.122485 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f39ef-1f3c-4f78-bc1d-3748dbb95299 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:31.122758 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f39ef-1f3c-4f78-bc1d-3748dbb95299 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:31.123029 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f39ef-1f3c-4f78-bc1d-3748dbb95299 None admin] PATH_INFO: `/v3/roles/service` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:31.133856 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f39ef-1f3c-4f78-bc1d-3748dbb95299 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-da7f39ef-1f3c-4f78-bc1d-3748dbb95299 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:33:31.138998 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:31.140099 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:31.140969 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 318/640] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:33:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:31.146821 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f8cf4-e0ea-4cce-b951-78b5733f0e54 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:31.193643 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:31.258578 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f8cf4-e0ea-4cce-b951-78b5733f0e54 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:31.295222 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2c1e2-f06b-4332-a95a-a2e002c8a107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:31.296063 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2c1e2-f06b-4332-a95a-a2e002c8a107 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:31.296443 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2c1e2-f06b-4332-a95a-a2e002c8a107 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:31.296796 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2c1e2-f06b-4332-a95a-a2e002c8a107 None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:31.297464 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2c1e2-f06b-4332-a95a-a2e002c8a107 None admin] RBAC: Adding query filter params (name=service) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:31.297753 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2c1e2-f06b-4332-a95a-a2e002c8a107 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:31.299143 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2c1e2-f06b-4332-a95a-a2e002c8a107 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:31.307617 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 323/641] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:33:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:31.314157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f39ef-1f3c-4f78-bc1d-3748dbb95299 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:31.362989 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:31.422697 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f39ef-1f3c-4f78-bc1d-3748dbb95299 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:31.460731 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712add4-3c8e-4845-8fcd-56466d0827b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:31.461355 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712add4-3c8e-4845-8fcd-56466d0827b2 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:31.461663 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712add4-3c8e-4845-8fcd-56466d0827b2 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:31.461928 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712add4-3c8e-4845-8fcd-56466d0827b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:31.473533 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712add4-3c8e-4845-8fcd-56466d0827b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:31.475008 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712add4-3c8e-4845-8fcd-56466d0827b2 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-f712add4-3c8e-4845-8fcd-56466d0827b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:33:31.491690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:31.492709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:33:31.494086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:33:31.494086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:31.494086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:31.494086 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 319/642] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:31.499029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2c1e2-f06b-4332-a95a-a2e002c8a107 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:31.608384 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:31.611859 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2c1e2-f06b-4332-a95a-a2e002c8a107 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:31.650803 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9d406-9b97-4293-954f-ea378458d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:31.651445 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9d406-9b97-4293-954f-ea378458d646 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:31.651722 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9d406-9b97-4293-954f-ea378458d646 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:31.651991 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9d406-9b97-4293-954f-ea378458d646 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:31.652700 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9d406-9b97-4293-954f-ea378458d646 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:31.653087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9d406-9b97-4293-954f-ea378458d646 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:31.654738 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c9d406-9b97-4293-954f-ea378458d646 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:31.669501 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 324/643] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:33:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:31.675616 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712add4-3c8e-4845-8fcd-56466d0827b2 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:31.779991 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:31.784575 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712add4-3c8e-4845-8fcd-56466d0827b2 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:31.822886 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39034-8ae1-4ac0-a9cf-8d8f597647b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:31.823558 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39034-8ae1-4ac0-a9cf-8d8f597647b3 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:31.823826 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39034-8ae1-4ac0-a9cf-8d8f597647b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:31.824127 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd39034-8ae1-4ac0-a9cf-8d8f597647b3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:31.832774 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd39034-8ae1-4ac0-a9cf-8d8f597647b3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:31.834227 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd39034-8ae1-4ac0-a9cf-8d8f597647b3 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-afd39034-8ae1-4ac0-a9cf-8d8f597647b3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:33:31.846564 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:31.847997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:31.849150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 320/644] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:33:31.854433 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9d406-9b97-4293-954f-ea378458d646 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:31.965631 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c9d406-9b97-4293-954f-ea378458d646 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:32.004344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee02f8-79b9-410c-8690-bb2c3e7b7423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:32.005020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee02f8-79b9-410c-8690-bb2c3e7b7423 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:32.005216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee02f8-79b9-410c-8690-bb2c3e7b7423 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:32.005488 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee02f8-79b9-410c-8690-bb2c3e7b7423 None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:32.006215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee02f8-79b9-410c-8690-bb2c3e7b7423 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:32.006512 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee02f8-79b9-410c-8690-bb2c3e7b7423 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:32.008047 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee02f8-79b9-410c-8690-bb2c3e7b7423 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:32.026038 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 325/645] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Oct 22 20:33:31 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:32.032003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39034-8ae1-4ac0-a9cf-8d8f597647b3 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:32.150070 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd39034-8ae1-4ac0-a9cf-8d8f597647b3 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:32.188145 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26575802-4804-400b-817e-5287e107e965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:32.188762 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26575802-4804-400b-817e-5287e107e965 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:32.189219 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26575802-4804-400b-817e-5287e107e965 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:32.189585 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26575802-4804-400b-817e-5287e107e965 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:32.201975 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26575802-4804-400b-817e-5287e107e965 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:32.203679 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26575802-4804-400b-817e-5287e107e965 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-26575802-4804-400b-817e-5287e107e965 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:33:32.221953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:32.222981 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:33:32.224296 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:33:32.224296 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:32.224296 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:32.224296 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 321/646] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:32.229859 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee02f8-79b9-410c-8690-bb2c3e7b7423 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:32.250838 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:32.336256 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee02f8-79b9-410c-8690-bb2c3e7b7423 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:32.371205 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37717-0a69-4410-906e-a6c9a02109e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:32.371862 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37717-0a69-4410-906e-a6c9a02109e5 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:32.372126 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37717-0a69-4410-906e-a6c9a02109e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:32.372390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e37717-0a69-4410-906e-a6c9a02109e5 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:32.373026 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37717-0a69-4410-906e-a6c9a02109e5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:32.373326 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37717-0a69-4410-906e-a6c9a02109e5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:32.374709 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e37717-0a69-4410-906e-a6c9a02109e5 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:32.386096 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 326/647] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:32.392185 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26575802-4804-400b-817e-5287e107e965 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:32.408493 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:32.507881 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26575802-4804-400b-817e-5287e107e965 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:32.548737 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09f29-c5fe-4d36-9d0b-309afedef7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:32.549541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09f29-c5fe-4d36-9d0b-309afedef7ae None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:32.549934 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09f29-c5fe-4d36-9d0b-309afedef7ae None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:32.550201 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a09f29-c5fe-4d36-9d0b-309afedef7ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:32.557890 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a09f29-c5fe-4d36-9d0b-309afedef7ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:32.559454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a09f29-c5fe-4d36-9d0b-309afedef7ae None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-d4a09f29-c5fe-4d36-9d0b-309afedef7ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:33:32.572297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:32.573430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:32.574487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:33:32.574487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:33:32.574487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:33:32.574487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:33:32.574487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:33:32.574487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:33:32.574487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:33:32.574487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:32.574487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 322/648] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:33:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:32.579476 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37717-0a69-4410-906e-a6c9a02109e5 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:32.661105 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:32.685884 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e37717-0a69-4410-906e-a6c9a02109e5 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:32.720210 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39310d7a-7393-4d5f-87f4-aecc4cc8bbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:32.720872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310d7a-7393-4d5f-87f4-aecc4cc8bbe9 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:32.721149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310d7a-7393-4d5f-87f4-aecc4cc8bbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:32.721421 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39310d7a-7393-4d5f-87f4-aecc4cc8bbe9 None admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:32.722087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39310d7a-7393-4d5f-87f4-aecc4cc8bbe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:32.722383 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39310d7a-7393-4d5f-87f4-aecc4cc8bbe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:32.723857 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39310d7a-7393-4d5f-87f4-aecc4cc8bbe9 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:32.736457 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 327/649] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:33:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:32.742874 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09f29-c5fe-4d36-9d0b-309afedef7ae None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:32.822942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:32.857214 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a09f29-c5fe-4d36-9d0b-309afedef7ae None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:32.902253 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdd32d-e183-4a40-a336-db06f161dc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:32.903299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdd32d-e183-4a40-a336-db06f161dc1c None admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:32.903587 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdd32d-e183-4a40-a336-db06f161dc1c None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:32.903857 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdd32d-e183-4a40-a336-db06f161dc1c None admin] PATH_INFO: `/v3/projects/994d024676c1425fa15492ab23e267fd/users/9b73c8f104d7476294921098cec0a8bf/roles/9f6b3138dda04fc884ae8e76a78e2865` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:32.924467 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdd32d-e183-4a40-a336-db06f161dc1c None admin] RBAC: Authorizing `identity:create_grant(project_id=994d024676c1425fa15492ab23e267fd, user_id=9b73c8f104d7476294921098cec0a8bf, role_id=9f6b3138dda04fc884ae8e76a78e2865)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:32.925935 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdd32d-e183-4a40-a336-db06f161dc1c None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:32.939553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 323/650] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:33:32 2022] PUT /identity/v3/projects/994d024676c1425fa15492ab23e267fd/users/9b73c8f104d7476294921098cec0a8bf/roles/9f6b3138dda04fc884ae8e76a78e2865 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:33:35.442541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f27e8b-c597-44f9-bdf8-28257fa920e9 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:35.443075 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f27e8b-c597-44f9-bdf8-28257fa920e9 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:35.443075 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f27e8b-c597-44f9-bdf8-28257fa920e9 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:35.444532 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 328/651] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:33:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:33:35.450512 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79f59e-30c6-409e-8024-c82d3cf5ae62 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:35.450968 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79f59e-30c6-409e-8024-c82d3cf5ae62 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:35.451195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e79f59e-30c6-409e-8024-c82d3cf5ae62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:35.473438 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-4e79f59e-30c6-409e-8024-c82d3cf5ae62 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:33:35.474678 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-4e79f59e-30c6-409e-8024-c82d3cf5ae62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:33:35.549673 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 324/652] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:33:35 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:33:35.883860 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f27e8b-c597-44f9-bdf8-28257fa920e9 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:35.998011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f27e8b-c597-44f9-bdf8-28257fa920e9 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:36.040551 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117248a-83c5-45db-bc9e-e7644692ac2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:36.041197 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117248a-83c5-45db-bc9e-e7644692ac2b None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:36.041466 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117248a-83c5-45db-bc9e-e7644692ac2b None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:36.041825 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117248a-83c5-45db-bc9e-e7644692ac2b None admin] PATH_INFO: `/v3/roles/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:36.049980 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:36.054342 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117248a-83c5-45db-bc9e-e7644692ac2b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-4117248a-83c5-45db-bc9e-e7644692ac2b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:33:36.059317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:36.060252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:36.061390 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 329/653] 10.222.0.39 () {56 vars in 1102 bytes} [Sat Oct 22 20:33:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:36.067027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79f59e-30c6-409e-8024-c82d3cf5ae62 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:36.117326 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:36.174952 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e79f59e-30c6-409e-8024-c82d3cf5ae62 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:36.212538 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f20aaf-7549-4c24-b1b0-2e5a26a9076c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:36.213366 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f20aaf-7549-4c24-b1b0-2e5a26a9076c None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:36.213733 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f20aaf-7549-4c24-b1b0-2e5a26a9076c None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:36.214001 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f20aaf-7549-4c24-b1b0-2e5a26a9076c None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:36.214787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f20aaf-7549-4c24-b1b0-2e5a26a9076c None admin] RBAC: Adding query filter params (name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:36.215088 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f20aaf-7549-4c24-b1b0-2e5a26a9076c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:36.216819 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f20aaf-7549-4c24-b1b0-2e5a26a9076c None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:36.226904 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 325/654] 10.222.0.39 () {56 vars in 1103 bytes} [Sat Oct 22 20:33:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:36.233379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117248a-83c5-45db-bc9e-e7644692ac2b None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:36.342845 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117248a-83c5-45db-bc9e-e7644692ac2b None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:36.381639 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30a37-49bc-43bb-9fd3-f69c13c4c5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:36.382509 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30a37-49bc-43bb-9fd3-f69c13c4c5fc None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:36.382807 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30a37-49bc-43bb-9fd3-f69c13c4c5fc None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:36.383123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad30a37-49bc-43bb-9fd3-f69c13c4c5fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:36.395189 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad30a37-49bc-43bb-9fd3-f69c13c4c5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:36.396677 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad30a37-49bc-43bb-9fd3-f69c13c4c5fc None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-2ad30a37-49bc-43bb-9fd3-f69c13c4c5fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:33:36.414083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:36.415121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:33:36.416028 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:33:36.416028 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:36.416028 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:36.420240 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 330/655] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:33:36.421493 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f20aaf-7549-4c24-b1b0-2e5a26a9076c None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:36.533817 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f20aaf-7549-4c24-b1b0-2e5a26a9076c None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:36.549814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:36.580990 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20f380-5862-4462-a311-d7493b68919a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:36.582067 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20f380-5862-4462-a311-d7493b68919a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:36.582421 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20f380-5862-4462-a311-d7493b68919a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:36.582709 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d20f380-5862-4462-a311-d7493b68919a None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:36.583519 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20f380-5862-4462-a311-d7493b68919a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:36.583814 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20f380-5862-4462-a311-d7493b68919a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:36.585392 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d20f380-5862-4462-a311-d7493b68919a None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:36.599064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 326/656] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:33:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:36.605152 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30a37-49bc-43bb-9fd3-f69c13c4c5fc None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:36.658614 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:36.715087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad30a37-49bc-43bb-9fd3-f69c13c4c5fc None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:36.755015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e70a9-c935-473c-8daa-e113576067a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:36.755673 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e70a9-c935-473c-8daa-e113576067a7 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:36.755951 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e70a9-c935-473c-8daa-e113576067a7 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:36.756219 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4e70a9-c935-473c-8daa-e113576067a7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:36.764134 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e70a9-c935-473c-8daa-e113576067a7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:36.765754 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4e70a9-c935-473c-8daa-e113576067a7 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-fc4e70a9-c935-473c-8daa-e113576067a7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:33:36.777379 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:36.778424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 22 20:33:36.779535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:36.781475 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 331/657] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:36.788347 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20f380-5862-4462-a311-d7493b68919a None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:36.895725 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d20f380-5862-4462-a311-d7493b68919a None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:36.936011 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949dfda-b3ad-4312-a374-b4e1392ca1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:36.936694 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949dfda-b3ad-4312-a374-b4e1392ca1f1 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:36.936953 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949dfda-b3ad-4312-a374-b4e1392ca1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:36.937226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c949dfda-b3ad-4312-a374-b4e1392ca1f1 None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:36.937951 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949dfda-b3ad-4312-a374-b4e1392ca1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:36.938250 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949dfda-b3ad-4312-a374-b4e1392ca1f1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:36.939754 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c949dfda-b3ad-4312-a374-b4e1392ca1f1 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:36.957656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 327/658] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Oct 22 20:33:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:36.964013 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e70a9-c935-473c-8daa-e113576067a7 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:37.080929 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4e70a9-c935-473c-8daa-e113576067a7 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:37.092267 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:37.121591 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31002fb0-5da3-4864-b634-e3112f6ba98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:37.121591 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31002fb0-5da3-4864-b634-e3112f6ba98c None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:37.121591 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31002fb0-5da3-4864-b634-e3112f6ba98c None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:37.121591 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31002fb0-5da3-4864-b634-e3112f6ba98c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:37.197756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31002fb0-5da3-4864-b634-e3112f6ba98c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:37.199672 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31002fb0-5da3-4864-b634-e3112f6ba98c None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:37.313926 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 332/659] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:33:36 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 20:33:37.319941 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949dfda-b3ad-4312-a374-b4e1392ca1f1 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:37.354425 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:37.430845 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c949dfda-b3ad-4312-a374-b4e1392ca1f1 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:37.469968 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aebae-d3f0-42bc-a7bb-b488ffa29a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:37.470631 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aebae-d3f0-42bc-a7bb-b488ffa29a53 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:37.471056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aebae-d3f0-42bc-a7bb-b488ffa29a53 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:37.471526 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9aebae-d3f0-42bc-a7bb-b488ffa29a53 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:37.484006 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aebae-d3f0-42bc-a7bb-b488ffa29a53 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:37.485445 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9aebae-d3f0-42bc-a7bb-b488ffa29a53 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-3d9aebae-d3f0-42bc-a7bb-b488ffa29a53 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:33:37.500505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:37.501658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:33:37.503029 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:33:37.503029 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:37.503029 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:37.503029 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 328/660] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:37.507624 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31002fb0-5da3-4864-b634-e3112f6ba98c None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:37.519990 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:37.615790 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31002fb0-5da3-4864-b634-e3112f6ba98c None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:37.654221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f25f28-cccb-4d13-b443-83379aa7f1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:37.655070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25f28-cccb-4d13-b443-83379aa7f1f4 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:37.655387 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25f28-cccb-4d13-b443-83379aa7f1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:37.655663 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f25f28-cccb-4d13-b443-83379aa7f1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:37.656463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f25f28-cccb-4d13-b443-83379aa7f1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:37.656808 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f25f28-cccb-4d13-b443-83379aa7f1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:37.658769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f25f28-cccb-4d13-b443-83379aa7f1f4 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:37.672320 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 333/661] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:37.678503 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aebae-d3f0-42bc-a7bb-b488ffa29a53 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:37.763968 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:37.783512 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9aebae-d3f0-42bc-a7bb-b488ffa29a53 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:37.818868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4bdc-ba46-47ca-90ef-d591c529f28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:37.819494 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4bdc-ba46-47ca-90ef-d591c529f28f None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:37.819771 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4bdc-ba46-47ca-90ef-d591c529f28f None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:37.820076 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b4bdc-ba46-47ca-90ef-d591c529f28f None admin] PATH_INFO: `/v3/projects/service` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:37.827288 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4bdc-ba46-47ca-90ef-d591c529f28f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:37.828853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b4bdc-ba46-47ca-90ef-d591c529f28f None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-dd6b4bdc-ba46-47ca-90ef-d591c529f28f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:33:37.840314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:37.841373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:37.842456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:33:37.842456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:33:37.842456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:33:37.842456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:33:37.842456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:33:37.842456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:33:37.842456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:33:37.842456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:37.842456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 329/662] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:33:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:33:37.847923 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f25f28-cccb-4d13-b443-83379aa7f1f4 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:37.920984 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:37.970578 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f25f28-cccb-4d13-b443-83379aa7f1f4 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:38.025482 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae12876-2670-403f-b563-df41c66ab129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:38.026440 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12876-2670-403f-b563-df41c66ab129 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:38.026818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12876-2670-403f-b563-df41c66ab129 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:38.027317 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae12876-2670-403f-b563-df41c66ab129 None admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:38.028211 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae12876-2670-403f-b563-df41c66ab129 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:38.028639 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae12876-2670-403f-b563-df41c66ab129 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:38.030924 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae12876-2670-403f-b563-df41c66ab129 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:38.050050 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 334/663] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:33:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:38.056315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4bdc-ba46-47ca-90ef-d591c529f28f None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:38.169738 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b4bdc-ba46-47ca-90ef-d591c529f28f None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:38.205557 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd65841-6a1c-46fc-8bf3-f0a26d4081db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:38.206157 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd65841-6a1c-46fc-8bf3-f0a26d4081db None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:38.206431 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd65841-6a1c-46fc-8bf3-f0a26d4081db None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:38.206698 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd65841-6a1c-46fc-8bf3-f0a26d4081db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:38.207441 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd65841-6a1c-46fc-8bf3-f0a26d4081db None admin] RBAC: Adding query filter params (role.id=9f6b3138dda04fc884ae8e76a78e2865, scope.project.id=994d024676c1425fa15492ab23e267fd, user.id=9b73c8f104d7476294921098cec0a8bf) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:38.207753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd65841-6a1c-46fc-8bf3-f0a26d4081db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:38.210340 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd65841-6a1c-46fc-8bf3-f0a26d4081db None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:38.217410 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 330/664] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:33:38 2022] GET /identity/v3/role_assignments?user.id=9b73c8f104d7476294921098cec0a8bf&scope.project.id=994d024676c1425fa15492ab23e267fd&role.id=9f6b3138dda04fc884ae8e76a78e2865 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:40.717391 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab4ce4-1e90-4432-9c77-179969573649 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:40.717959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab4ce4-1e90-4432-9c77-179969573649 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:40.717959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab4ce4-1e90-4432-9c77-179969573649 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:40.719246 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 335/665] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:33:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:33:40.727303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c76d-9987-484f-b0c0-13871e872644 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:40.727303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c76d-9987-484f-b0c0-13871e872644 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:40.727303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c52c76d-9987-484f-b0c0-13871e872644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:40.738669 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:40.744292 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-6c52c76d-9987-484f-b0c0-13871e872644 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:33:40.745504 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-6c52c76d-9987-484f-b0c0-13871e872644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:33:40.818150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 331/666] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:33:40 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:33:41.162340 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab4ce4-1e90-4432-9c77-179969573649 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:41.273574 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab4ce4-1e90-4432-9c77-179969573649 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:41.309101 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:41.315932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93ced-2c3e-46c1-98d2-970735e977e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:41.316588 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93ced-2c3e-46c1-98d2-970735e977e7 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:41.316862 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93ced-2c3e-46c1-98d2-970735e977e7 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:41.317132 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c93ced-2c3e-46c1-98d2-970735e977e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:41.327609 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c93ced-2c3e-46c1-98d2-970735e977e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-83c93ced-2c3e-46c1-98d2-970735e977e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:33:41.332505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:41.333764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:41.334746 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 336/667] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:33:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:41.340330 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52c76d-9987-484f-b0c0-13871e872644 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:41.454246 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c52c76d-9987-484f-b0c0-13871e872644 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:41.493925 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16830a4-2c23-4869-a539-9fe82df6c0ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:41.494511 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16830a4-2c23-4869-a539-9fe82df6c0ff None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:41.494801 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16830a4-2c23-4869-a539-9fe82df6c0ff None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:41.495069 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16830a4-2c23-4869-a539-9fe82df6c0ff None admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:41.495804 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16830a4-2c23-4869-a539-9fe82df6c0ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:41.496123 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16830a4-2c23-4869-a539-9fe82df6c0ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:41.497534 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16830a4-2c23-4869-a539-9fe82df6c0ff None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:41.499915 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:41.507437 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 332/668] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:33:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:41.513242 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93ced-2c3e-46c1-98d2-970735e977e7 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:41.633404 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c93ced-2c3e-46c1-98d2-970735e977e7 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:41.670394 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a1978-b796-4463-a46f-53925616e2e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:41.671138 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a1978-b796-4463-a46f-53925616e2e5 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:41.671575 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a1978-b796-4463-a46f-53925616e2e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:41.671872 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740a1978-b796-4463-a46f-53925616e2e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:41.683721 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a1978-b796-4463-a46f-53925616e2e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:41.685165 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740a1978-b796-4463-a46f-53925616e2e5 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-740a1978-b796-4463-a46f-53925616e2e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:33:41.700544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:41.701644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:33:41.702708 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:33:41.702708 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:41.702708 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:41.702708 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 337/669] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:41.707988 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16830a4-2c23-4869-a539-9fe82df6c0ff None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:41.817650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16830a4-2c23-4869-a539-9fe82df6c0ff None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:41.856318 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d07e-e11f-4b8f-ab9c-a7e474e83b2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:41.856906 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d07e-e11f-4b8f-ab9c-a7e474e83b2a None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:41.857183 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d07e-e11f-4b8f-ab9c-a7e474e83b2a None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:41.857464 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e77d07e-e11f-4b8f-ab9c-a7e474e83b2a None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:41.858074 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d07e-e11f-4b8f-ab9c-a7e474e83b2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:41.858369 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d07e-e11f-4b8f-ab9c-a7e474e83b2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:41.859767 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e77d07e-e11f-4b8f-ab9c-a7e474e83b2a None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:41.871661 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 333/670] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:33:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:41.877489 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a1978-b796-4463-a46f-53925616e2e5 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:41.922008 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:41.979612 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740a1978-b796-4463-a46f-53925616e2e5 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:42.016282 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e7e0-de3b-4a7c-b002-571add83a088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:42.017065 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e7e0-de3b-4a7c-b002-571add83a088 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:42.017508 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e7e0-de3b-4a7c-b002-571add83a088 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:42.017890 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe5e7e0-de3b-4a7c-b002-571add83a088 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:42.028337 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5e7e0-de3b-4a7c-b002-571add83a088 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:42.030114 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe5e7e0-de3b-4a7c-b002-571add83a088 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-2fe5e7e0-de3b-4a7c-b002-571add83a088 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:33:42.042765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:42.044011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 22 20:33:42.044939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:42.049427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 338/671] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:42.050472 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d07e-e11f-4b8f-ab9c-a7e474e83b2a None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:42.116112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:42.162830 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e77d07e-e11f-4b8f-ab9c-a7e474e83b2a None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:42.199103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7da36-593c-4f8d-84c8-26a1c48bb5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:42.199782 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7da36-593c-4f8d-84c8-26a1c48bb5e4 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:42.200054 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7da36-593c-4f8d-84c8-26a1c48bb5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:42.200319 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f7da36-593c-4f8d-84c8-26a1c48bb5e4 None admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:42.201121 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7da36-593c-4f8d-84c8-26a1c48bb5e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:42.201417 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7da36-593c-4f8d-84c8-26a1c48bb5e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:42.202838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f7da36-593c-4f8d-84c8-26a1c48bb5e4 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:42.221065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 334/672] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Oct 22 20:33:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:33:42.226826 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e7e0-de3b-4a7c-b002-571add83a088 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:42.333635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe5e7e0-de3b-4a7c-b002-571add83a088 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:42.335090 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:42.369813 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f6640-b181-4197-9e84-17f233eacb83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:42.370341 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f6640-b181-4197-9e84-17f233eacb83 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:42.370619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f6640-b181-4197-9e84-17f233eacb83 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:42.370888 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f6640-b181-4197-9e84-17f233eacb83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:42.382109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f6640-b181-4197-9e84-17f233eacb83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:42.383743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f6640-b181-4197-9e84-17f233eacb83 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-5e4f6640-b181-4197-9e84-17f233eacb83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:33:42.399823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:42.400954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:33:42.402214 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:33:42.402214 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:42.402214 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:42.402214 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 339/673] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:42.406946 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7da36-593c-4f8d-84c8-26a1c48bb5e4 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:42.515280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f7da36-593c-4f8d-84c8-26a1c48bb5e4 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:42.539556 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:42.559505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4101e-5d31-4587-9e6f-cba3ba35b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:42.560103 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4101e-5d31-4587-9e6f-cba3ba35b963 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:42.560377 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4101e-5d31-4587-9e6f-cba3ba35b963 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:42.560642 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f4101e-5d31-4587-9e6f-cba3ba35b963 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:42.561275 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4101e-5d31-4587-9e6f-cba3ba35b963 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:42.561570 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4101e-5d31-4587-9e6f-cba3ba35b963 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:42.562943 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f4101e-5d31-4587-9e6f-cba3ba35b963 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:42.700465 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 335/674] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:33:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:42.706173 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f6640-b181-4197-9e84-17f233eacb83 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:42.812441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f6640-b181-4197-9e84-17f233eacb83 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:42.850438 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212978d6-1074-4099-af25-a578ebd5786b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:42.851284 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212978d6-1074-4099-af25-a578ebd5786b None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:42.851580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212978d6-1074-4099-af25-a578ebd5786b None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:42.851924 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212978d6-1074-4099-af25-a578ebd5786b None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:42.862265 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212978d6-1074-4099-af25-a578ebd5786b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:42.863904 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212978d6-1074-4099-af25-a578ebd5786b None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-212978d6-1074-4099-af25-a578ebd5786b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:33:42.876785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:42.878978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:42.880641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:33:42.880641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:33:42.880641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:33:42.880641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:33:42.880641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:33:42.880641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:33:42.880641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:33:42.880641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:42.880641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 340/675] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:33:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Oct 22 20:33:42.884038 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4101e-5d31-4587-9e6f-cba3ba35b963 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:43.001072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f4101e-5d31-4587-9e6f-cba3ba35b963 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:43.039866 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e6a02-5058-435a-92e7-28a308977096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:43.040498 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e6a02-5058-435a-92e7-28a308977096 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:43.040807 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e6a02-5058-435a-92e7-28a308977096 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:43.041040 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e6a02-5058-435a-92e7-28a308977096 None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:43.041742 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e6a02-5058-435a-92e7-28a308977096 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:43.042053 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e6a02-5058-435a-92e7-28a308977096 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:43.043667 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e6a02-5058-435a-92e7-28a308977096 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:43.057434 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 336/676] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:33:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:43.063870 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212978d6-1074-4099-af25-a578ebd5786b None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:43.082094 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:43.178721 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212978d6-1074-4099-af25-a578ebd5786b None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:43.216997 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff85f0c-be9f-4564-b251-2cd254899177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:43.217863 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff85f0c-be9f-4564-b251-2cd254899177 None admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:43.218134 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff85f0c-be9f-4564-b251-2cd254899177 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:43.218421 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff85f0c-be9f-4564-b251-2cd254899177 None admin] PATH_INFO: `/v3/projects/994d024676c1425fa15492ab23e267fd/users/9b73c8f104d7476294921098cec0a8bf/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:43.220457 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff85f0c-be9f-4564-b251-2cd254899177 None admin] RBAC: Authorizing `identity:create_grant(project_id=994d024676c1425fa15492ab23e267fd, user_id=9b73c8f104d7476294921098cec0a8bf, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:43.222427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff85f0c-be9f-4564-b251-2cd254899177 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:43.238974 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 341/677] 10.222.0.39 () {58 vars in 1439 bytes} [Sat Oct 22 20:33:43 2022] PUT /identity/v3/projects/994d024676c1425fa15492ab23e267fd/users/9b73c8f104d7476294921098cec0a8bf/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:33:45.721300 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b895dab-893c-4181-a3f9-dacdb792056f None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:45.721891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b895dab-893c-4181-a3f9-dacdb792056f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:45.721891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b895dab-893c-4181-a3f9-dacdb792056f None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:45.723135 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 337/678] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:33:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:33:45.729316 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55316506-973b-433a-bc81-721e3bbef0f2 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:45.729842 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55316506-973b-433a-bc81-721e3bbef0f2 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:45.729842 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55316506-973b-433a-bc81-721e3bbef0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:45.749444 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-55316506-973b-433a-bc81-721e3bbef0f2 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:33:45.750665 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-55316506-973b-433a-bc81-721e3bbef0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:33:45.823201 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 342/679] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:33:45 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:33:46.146303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b895dab-893c-4181-a3f9-dacdb792056f None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:46.194222 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:46.262763 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b895dab-893c-4181-a3f9-dacdb792056f None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:46.305831 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c114b-c80d-417a-afc6-cb12d66f10a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:46.306436 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c114b-c80d-417a-afc6-cb12d66f10a1 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:46.306703 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c114b-c80d-417a-afc6-cb12d66f10a1 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:46.306963 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c114b-c80d-417a-afc6-cb12d66f10a1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:46.317870 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551c114b-c80d-417a-afc6-cb12d66f10a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-551c114b-c80d-417a-afc6-cb12d66f10a1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(role_id) Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Oct 22 20:33:46.322610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:46.323753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:46.324571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 338/680] 10.222.0.39 () {56 vars in 1096 bytes} [Sat Oct 22 20:33:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:46.331250 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55316506-973b-433a-bc81-721e3bbef0f2 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:46.334375 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:46.437785 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55316506-973b-433a-bc81-721e3bbef0f2 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:46.479495 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc70b-cd4e-4623-89f8-1bf34caf4bc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:46.480087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc70b-cd4e-4623-89f8-1bf34caf4bc1 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:46.480355 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc70b-cd4e-4623-89f8-1bf34caf4bc1 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:46.480615 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20bc70b-cd4e-4623-89f8-1bf34caf4bc1 None admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:46.481264 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bc70b-cd4e-4623-89f8-1bf34caf4bc1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:46.481557 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bc70b-cd4e-4623-89f8-1bf34caf4bc1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:46.482903 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20bc70b-cd4e-4623-89f8-1bf34caf4bc1 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:46.491014 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 343/681] 10.222.0.39 () {56 vars in 1099 bytes} [Sat Oct 22 20:33:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:33:46.497610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c114b-c80d-417a-afc6-cb12d66f10a1 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:46.602359 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:46.609336 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c114b-c80d-417a-afc6-cb12d66f10a1 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:46.645488 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57195b11-8b4b-4095-b7f2-56a67cc8e4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:46.646089 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57195b11-8b4b-4095-b7f2-56a67cc8e4ce None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:46.646361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57195b11-8b4b-4095-b7f2-56a67cc8e4ce None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:46.646624 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57195b11-8b4b-4095-b7f2-56a67cc8e4ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:46.657482 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57195b11-8b4b-4095-b7f2-56a67cc8e4ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:46.658924 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57195b11-8b4b-4095-b7f2-56a67cc8e4ce None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-57195b11-8b4b-4095-b7f2-56a67cc8e4ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:33:46.673811 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:46.674838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:33:46.676064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:33:46.676064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:46.676064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:46.676064 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 339/682] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:46.680873 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc70b-cd4e-4623-89f8-1bf34caf4bc1 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:46.751642 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:46.786348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20bc70b-cd4e-4623-89f8-1bf34caf4bc1 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:46.824333 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a99cc-9872-40dc-95cb-43fc0235bf00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:46.824924 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a99cc-9872-40dc-95cb-43fc0235bf00 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:46.825195 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a99cc-9872-40dc-95cb-43fc0235bf00 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:46.825464 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a99cc-9872-40dc-95cb-43fc0235bf00 None admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:46.826095 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a99cc-9872-40dc-95cb-43fc0235bf00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:46.826384 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a99cc-9872-40dc-95cb-43fc0235bf00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:46.827766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a99cc-9872-40dc-95cb-43fc0235bf00 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:46.839356 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 344/683] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:33:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:46.845908 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57195b11-8b4b-4095-b7f2-56a67cc8e4ce None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:46.958450 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57195b11-8b4b-4095-b7f2-56a67cc8e4ce None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:46.995639 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab5254-611f-47ee-9750-8c488f09c799 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:46.996944 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab5254-611f-47ee-9750-8c488f09c799 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:46.997198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab5254-611f-47ee-9750-8c488f09c799 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:46.997522 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ab5254-611f-47ee-9750-8c488f09c799 None admin] PATH_INFO: `/v3/users/placement` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:47.008208 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab5254-611f-47ee-9750-8c488f09c799 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:47.009574 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ab5254-611f-47ee-9750-8c488f09c799 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-40ab5254-611f-47ee-9750-8c488f09c799 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_user(user_id) Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Oct 22 20:33:47.021114 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:47.027229 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:47.028617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 340/684] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:47.029223 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a99cc-9872-40dc-95cb-43fc0235bf00 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:47.143750 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a99cc-9872-40dc-95cb-43fc0235bf00 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:47.299022 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:47.308838 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d977570-0c63-40b7-8cf4-d3f58ff5c89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:47.309432 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977570-0c63-40b7-8cf4-d3f58ff5c89e None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:47.309713 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977570-0c63-40b7-8cf4-d3f58ff5c89e None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:47.309979 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d977570-0c63-40b7-8cf4-d3f58ff5c89e None admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:47.310698 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d977570-0c63-40b7-8cf4-d3f58ff5c89e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:47.310992 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d977570-0c63-40b7-8cf4-d3f58ff5c89e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:47.312424 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d977570-0c63-40b7-8cf4-d3f58ff5c89e None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:47.333994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 345/685] 10.222.0.39 () {56 vars in 1143 bytes} [Sat Oct 22 20:33:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:47.342656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab5254-611f-47ee-9750-8c488f09c799 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:47.355986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:47.451609 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ab5254-611f-47ee-9750-8c488f09c799 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:47.488421 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0aa5-3c6b-4604-99fe-dc0261a683d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:47.489009 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0aa5-3c6b-4604-99fe-dc0261a683d5 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:47.489285 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0aa5-3c6b-4604-99fe-dc0261a683d5 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:47.489553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ec0aa5-3c6b-4604-99fe-dc0261a683d5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:47.559144 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec0aa5-3c6b-4604-99fe-dc0261a683d5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:47.560659 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ec0aa5-3c6b-4604-99fe-dc0261a683d5 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:47.570056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:47.669325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 341/686] 10.222.0.39 () {58 vars in 1282 bytes} [Sat Oct 22 20:33:47 2022] GET /identity/v3/auth/tokens => generated 1869 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Oct 22 20:33:47.676018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d977570-0c63-40b7-8cf4-d3f58ff5c89e None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:47.788021 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d977570-0c63-40b7-8cf4-d3f58ff5c89e None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:47.826065 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf5f3-be5e-40c2-839e-64b913a7acdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:47.826600 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf5f3-be5e-40c2-839e-64b913a7acdf None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:47.826870 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf5f3-be5e-40c2-839e-64b913a7acdf None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:47.827135 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edbf5f3-be5e-40c2-839e-64b913a7acdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:47.837508 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbf5f3-be5e-40c2-839e-64b913a7acdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:47.838927 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edbf5f3-be5e-40c2-839e-64b913a7acdf None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-9edbf5f3-be5e-40c2-839e-64b913a7acdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Oct 22 20:33:47.853787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:47.854735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Oct 22 20:33:47.855691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Oct 22 20:33:47.855691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Oct 22 20:33:47.855691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:47.855691 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 346/687] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:33:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:47.861043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0aa5-3c6b-4604-99fe-dc0261a683d5 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:47.962269 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ec0aa5-3c6b-4604-99fe-dc0261a683d5 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:47.971536 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:47.998980 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f6800-9cff-4c68-835f-a0eca143e895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:47.999791 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f6800-9cff-4c68-835f-a0eca143e895 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:48.000046 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f6800-9cff-4c68-835f-a0eca143e895 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:48.000374 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69f6800-9cff-4c68-835f-a0eca143e895 None admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:48.001226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f6800-9cff-4c68-835f-a0eca143e895 None admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:48.001606 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f6800-9cff-4c68-835f-a0eca143e895 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:48.003240 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69f6800-9cff-4c68-835f-a0eca143e895 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:48.016825 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 342/688] 10.222.0.39 () {56 vars in 1109 bytes} [Sat Oct 22 20:33:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:48.023561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf5f3-be5e-40c2-839e-64b913a7acdf None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:48.064433 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:48.131125 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edbf5f3-be5e-40c2-839e-64b913a7acdf None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:48.165512 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345708e-63c2-4545-bc3c-9573a80391e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:48.166122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345708e-63c2-4545-bc3c-9573a80391e5 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:48.166404 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345708e-63c2-4545-bc3c-9573a80391e5 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:48.166660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9345708e-63c2-4545-bc3c-9573a80391e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:48.173591 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345708e-63c2-4545-bc3c-9573a80391e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:48.175017 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9345708e-63c2-4545-bc3c-9573a80391e5 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application [None req-9345708e-63c2-4545-bc3c-9573a80391e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(project_id) Oct 22 20:33:48.186187 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:48.187180 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:48.188262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Oct 22 20:33:48.188262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Oct 22 20:33:48.188262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Oct 22 20:33:48.188262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Oct 22 20:33:48.188262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Oct 22 20:33:48.188262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Oct 22 20:33:48.188262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Oct 22 20:33:48.188262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: ERROR keystone.server.flask.application Oct 22 20:33:48.188262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 347/689] 10.222.0.39 () {56 vars in 1111 bytes} [Sat Oct 22 20:33:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:48.195696 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f6800-9cff-4c68-835f-a0eca143e895 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:48.304060 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69f6800-9cff-4c68-835f-a0eca143e895 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:48.343696 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfba9a2b-ba69-4fe7-8bd8-a08c83766e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:48.344553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba9a2b-ba69-4fe7-8bd8-a08c83766e26 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:48.344911 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba9a2b-ba69-4fe7-8bd8-a08c83766e26 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:48.345267 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfba9a2b-ba69-4fe7-8bd8-a08c83766e26 None admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:48.345945 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba9a2b-ba69-4fe7-8bd8-a08c83766e26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:48.346243 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba9a2b-ba69-4fe7-8bd8-a08c83766e26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:48.347703 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfba9a2b-ba69-4fe7-8bd8-a08c83766e26 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:48.360415 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 343/690] 10.222.0.39 () {56 vars in 1148 bytes} [Sat Oct 22 20:33:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:48.366626 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345708e-63c2-4545-bc3c-9573a80391e5 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:48.466172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:48.473561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9345708e-63c2-4545-bc3c-9573a80391e5 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:48.509866 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a65761e-8439-424c-9a96-c41dc2805060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:48.510460 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65761e-8439-424c-9a96-c41dc2805060 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:48.510735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65761e-8439-424c-9a96-c41dc2805060 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:48.510994 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a65761e-8439-424c-9a96-c41dc2805060 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:48.511747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65761e-8439-424c-9a96-c41dc2805060 None admin] RBAC: Adding query filter params (role.id=7fb86065b4ef4b98873a590a9c66cfdc, scope.project.id=994d024676c1425fa15492ab23e267fd, user.id=9b73c8f104d7476294921098cec0a8bf) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:48.512050 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65761e-8439-424c-9a96-c41dc2805060 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:48.513468 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a65761e-8439-424c-9a96-c41dc2805060 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:48.519288 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 348/691] 10.222.0.39 () {56 vars in 1374 bytes} [Sat Oct 22 20:33:48 2022] GET /identity/v3/role_assignments?user.id=9b73c8f104d7476294921098cec0a8bf&scope.project.id=994d024676c1425fa15492ab23e267fd&role.id=7fb86065b4ef4b98873a590a9c66cfdc => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:50.899313 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc4d9-d677-4e96-a18d-f1efc02f6ad5 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:50.900200 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc4d9-d677-4e96-a18d-f1efc02f6ad5 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:50.900200 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10adc4d9-d677-4e96-a18d-f1efc02f6ad5 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:50.902327 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 344/692] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:33:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:33:50.910774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c631cb-98a3-40fd-aaf4-58698f4251ad None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:50.911253 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c631cb-98a3-40fd-aaf4-58698f4251ad None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:50.911394 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c631cb-98a3-40fd-aaf4-58698f4251ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:50.934222 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-01c631cb-98a3-40fd-aaf4-58698f4251ad None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:33:50.935458 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-01c631cb-98a3-40fd-aaf4-58698f4251ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:33:51.005539 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 349/693] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:33:50 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:33:51.321534 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc4d9-d677-4e96-a18d-f1efc02f6ad5 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:51.357421 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:51.441027 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10adc4d9-d677-4e96-a18d-f1efc02f6ad5 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:51.475209 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1654e9-1ca0-490a-a208-1fcbd89d6198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:51.475843 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1654e9-1ca0-490a-a208-1fcbd89d6198 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:51.476112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1654e9-1ca0-490a-a208-1fcbd89d6198 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:51.476369 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1654e9-1ca0-490a-a208-1fcbd89d6198 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:51.476961 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1654e9-1ca0-490a-a208-1fcbd89d6198 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:51.478633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1654e9-1ca0-490a-a208-1fcbd89d6198 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-8e1654e9-1ca0-490a-a208-1fcbd89d6198 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:51.491122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:51.492286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:51.493307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 345/694] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Oct 22 20:33:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:51.500925 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c631cb-98a3-40fd-aaf4-58698f4251ad None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:51.607507 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:51.618090 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c631cb-98a3-40fd-aaf4-58698f4251ad None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:51.657678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b044f4-92f4-45cb-9905-de0f8c80af46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:51.658280 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b044f4-92f4-45cb-9905-de0f8c80af46 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:51.658575 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b044f4-92f4-45cb-9905-de0f8c80af46 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:51.658840 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b044f4-92f4-45cb-9905-de0f8c80af46 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:51.659492 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b044f4-92f4-45cb-9905-de0f8c80af46 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:51.659794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b044f4-92f4-45cb-9905-de0f8c80af46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:51.661159 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b044f4-92f4-45cb-9905-de0f8c80af46 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:51.666529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 350/695] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Oct 22 20:33:51 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:51.672391 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1654e9-1ca0-490a-a208-1fcbd89d6198 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:51.780891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:51.790014 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1654e9-1ca0-490a-a208-1fcbd89d6198 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:51.824312 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bc8e8-2fbe-4f5c-b83a-fa2d48353875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:51.824896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bc8e8-2fbe-4f5c-b83a-fa2d48353875 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:51.825168 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bc8e8-2fbe-4f5c-b83a-fa2d48353875 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:51.825433 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bc8e8-2fbe-4f5c-b83a-fa2d48353875 None admin] PATH_INFO: `/v3/services` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:51.826052 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bc8e8-2fbe-4f5c-b83a-fa2d48353875 None admin] RBAC: Adding query filter params (type=placement) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:51.826348 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bc8e8-2fbe-4f5c-b83a-fa2d48353875 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:51.827763 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bc8e8-2fbe-4f5c-b83a-fa2d48353875 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:51.832305 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 346/696] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Oct 22 20:33:51 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:54.182146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795ecf-e667-4476-975f-a6e721fef4fa None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:54.182704 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795ecf-e667-4476-975f-a6e721fef4fa None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:54.182704 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36795ecf-e667-4476-975f-a6e721fef4fa None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:54.184049 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 351/697] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:33:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:33:54.190643 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e44ca-fcb9-4608-8569-060c13f5ebfe None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:54.191391 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e44ca-fcb9-4608-8569-060c13f5ebfe None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:54.191542 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e44ca-fcb9-4608-8569-060c13f5ebfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:54.216370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-9f4e44ca-fcb9-4608-8569-060c13f5ebfe None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:33:54.217567 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-9f4e44ca-fcb9-4608-8569-060c13f5ebfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:33:54.298958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 347/698] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:33:54 2022] POST /identity/v3/auth/tokens => generated 1869 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:33:54.626151 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795ecf-e667-4476-975f-a6e721fef4fa None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:54.738561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36795ecf-e667-4476-975f-a6e721fef4fa None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:54.772846 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d08104-89c4-48e4-b83f-b67ce866d90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:54.773439 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08104-89c4-48e4-b83f-b67ce866d90c None admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:54.773710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08104-89c4-48e4-b83f-b67ce866d90c None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:54.773977 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d08104-89c4-48e4-b83f-b67ce866d90c None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:54.774621 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d08104-89c4-48e4-b83f-b67ce866d90c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:54.776020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d08104-89c4-48e4-b83f-b67ce866d90c None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:54.795153 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 352/699] 10.222.0.39 () {60 vars in 1141 bytes} [Sat Oct 22 20:33:54 2022] POST /identity/v3/services => generated 246 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:33:57.197487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9de908-f55e-467a-b4ae-0d7219f93eca None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:57.198327 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9de908-f55e-467a-b4ae-0d7219f93eca None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:57.198327 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9de908-f55e-467a-b4ae-0d7219f93eca None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:57.200537 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 348/700] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:33:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:33:57.207601 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9449a-4cbb-4a80-a636-49df21ecd899 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:57.208051 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9449a-4cbb-4a80-a636-49df21ecd899 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:57.208159 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea9449a-4cbb-4a80-a636-49df21ecd899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:57.227297 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-aea9449a-4cbb-4a80-a636-49df21ecd899 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:33:57.228809 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-aea9449a-4cbb-4a80-a636-49df21ecd899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:33:57.238676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:57.308083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 353/701] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:33:57 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:33:57.626722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9de908-f55e-467a-b4ae-0d7219f93eca None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:57.725756 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:57.743849 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9de908-f55e-467a-b4ae-0d7219f93eca None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:57.781170 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57475ef8-5947-4e9d-9cc2-ccb8526ed640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:57.781784 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57475ef8-5947-4e9d-9cc2-ccb8526ed640 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:57.782068 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57475ef8-5947-4e9d-9cc2-ccb8526ed640 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:57.782326 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57475ef8-5947-4e9d-9cc2-ccb8526ed640 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:57.782904 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57475ef8-5947-4e9d-9cc2-ccb8526ed640 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:57.784317 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57475ef8-5947-4e9d-9cc2-ccb8526ed640 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-57475ef8-5947-4e9d-9cc2-ccb8526ed640 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:33:57.793213 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:33:57.794248 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:33:57.795142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 349/702] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Oct 22 20:33:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:33:57.801372 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9449a-4cbb-4a80-a636-49df21ecd899 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:57.914710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea9449a-4cbb-4a80-a636-49df21ecd899 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:57.950537 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd343f-4b62-4814-8256-e026928f77b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:57.951118 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd343f-4b62-4814-8256-e026928f77b3 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:57.951427 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd343f-4b62-4814-8256-e026928f77b3 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:57.951692 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadd343f-4b62-4814-8256-e026928f77b3 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:57.952310 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd343f-4b62-4814-8256-e026928f77b3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:57.952636 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd343f-4b62-4814-8256-e026928f77b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:57.955618 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadd343f-4b62-4814-8256-e026928f77b3 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:57.960810 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 354/703] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Oct 22 20:33:57 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:57.966988 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57475ef8-5947-4e9d-9cc2-ccb8526ed640 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:58.091637 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57475ef8-5947-4e9d-9cc2-ccb8526ed640 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:58.129708 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0622559-e502-4368-a5e8-1527cf085d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:58.130298 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0622559-e502-4368-a5e8-1527cf085d90 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:58.130573 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0622559-e502-4368-a5e8-1527cf085d90 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:58.130841 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0622559-e502-4368-a5e8-1527cf085d90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:58.131560 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0622559-e502-4368-a5e8-1527cf085d90 None admin] RBAC: Adding query filter params (interface=public, service_id=8a634324fc8f4d0a9e2f501e1146ef1f, region_id=RegionOne) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:33:58.131854 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0622559-e502-4368-a5e8-1527cf085d90 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:58.133227 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0622559-e502-4368-a5e8-1527cf085d90 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:58.138346 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 350/704] 10.222.0.39 () {56 vars in 1251 bytes} [Sat Oct 22 20:33:57 2022] GET /identity/v3/endpoints?service_id=8a634324fc8f4d0a9e2f501e1146ef1f&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:33:58.144396 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd343f-4b62-4814-8256-e026928f77b3 None admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:33:58.148410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:33:58.249403 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadd343f-4b62-4814-8256-e026928f77b3 None admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:33:58.286915 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb574e62-7f58-48b9-b908-dab843333873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:33:58.287550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb574e62-7f58-48b9-b908-dab843333873 None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:33:58.287822 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb574e62-7f58-48b9-b908-dab843333873 None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:33:58.288087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb574e62-7f58-48b9-b908-dab843333873 None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:33:58.288686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb574e62-7f58-48b9-b908-dab843333873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:33:58.290048 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb574e62-7f58-48b9-b908-dab843333873 None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:33:58.296918 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 355/705] 10.222.0.39 () {56 vars in 1087 bytes} [Sat Oct 22 20:33:58 2022] GET /identity/v3/services => generated 1962 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:34:00.639380 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a813-e0e0-40e6-bd64-44f8f5262f35 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:34:00.640303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a813-e0e0-40e6-bd64-44f8f5262f35 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:34:00.640303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61a813-e0e0-40e6-bd64-44f8f5262f35 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:34:00.642401 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 351/706] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:34:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:34:00.648066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c319c-8162-4ddf-8a74-17f28ec97fcc None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:34:00.648497 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c319c-8162-4ddf-8a74-17f28ec97fcc None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:34:00.648497 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600c319c-8162-4ddf-8a74-17f28ec97fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:34:00.668626 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-600c319c-8162-4ddf-8a74-17f28ec97fcc None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:34:00.669799 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-600c319c-8162-4ddf-8a74-17f28ec97fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:34:00.732881 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:34:00.738708 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 356/707] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:34:00 2022] POST /identity/v3/auth/tokens => generated 1972 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Oct 22 20:34:01.064037 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a813-e0e0-40e6-bd64-44f8f5262f35 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:34:01.081179 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:34:01.175175 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae61a813-e0e0-40e6-bd64-44f8f5262f35 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:34:01.210507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa630e89-bf7e-4950-b0e8-99edd85bdc13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:34:01.211110 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa630e89-bf7e-4950-b0e8-99edd85bdc13 None admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:34:01.211407 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa630e89-bf7e-4950-b0e8-99edd85bdc13 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:34:01.211671 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa630e89-bf7e-4950-b0e8-99edd85bdc13 None admin] PATH_INFO: `/v3/services/placement` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:34:01.212239 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa630e89-bf7e-4950-b0e8-99edd85bdc13 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:34:01.213594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa630e89-bf7e-4950-b0e8-99edd85bdc13 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application [None req-fa630e89-bf7e-4950-b0e8-99edd85bdc13 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Traceback (most recent call last): Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application rv = self.dispatch_request() Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Oct 22 20:34:01.222439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._get_service(service_id) Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Oct 22 20:34:01.223644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.get_or_create( Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application with Lock( Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self._enter() Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application return self.creator() Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application created_value = creator( Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Oct 22 20:34:01.224779 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: ERROR keystone.server.flask.application Oct 22 20:34:01.227442 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 352/708] 10.222.0.39 () {56 vars in 1117 bytes} [Sat Oct 22 20:34:01 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Oct 22 20:34:01.230435 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c319c-8162-4ddf-8a74-17f28ec97fcc None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:34:01.346554 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600c319c-8162-4ddf-8a74-17f28ec97fcc None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:34:01.384984 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4a532e-d8c9-4e7b-bb0c-f9eedfab67ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:34:01.385578 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a532e-d8c9-4e7b-bb0c-f9eedfab67ad None admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:34:01.385849 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a532e-d8c9-4e7b-bb0c-f9eedfab67ad None admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:34:01.386110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4a532e-d8c9-4e7b-bb0c-f9eedfab67ad None admin] PATH_INFO: `/v3/services` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:34:01.386724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a532e-d8c9-4e7b-bb0c-f9eedfab67ad None admin] RBAC: Adding query filter params (name=placement) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:34:01.387013 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a532e-d8c9-4e7b-bb0c-f9eedfab67ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:34:01.388410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4a532e-d8c9-4e7b-bb0c-f9eedfab67ad None admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:34:01.393755 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 357/709] 10.222.0.39 () {56 vars in 1116 bytes} [Sat Oct 22 20:34:01 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:34:01.400221 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa630e89-bf7e-4950-b0e8-99edd85bdc13 None admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:34:01.480778 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:34:01.503120 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa630e89-bf7e-4950-b0e8-99edd85bdc13 None admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:34:01.537385 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b59e5a-8a93-4e0d-90b4-a5e2aaceb6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:34:01.537957 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59e5a-8a93-4e0d-90b4-a5e2aaceb6d2 None admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:34:01.538226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59e5a-8a93-4e0d-90b4-a5e2aaceb6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:34:01.538490 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b59e5a-8a93-4e0d-90b4-a5e2aaceb6d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:34:01.539161 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b59e5a-8a93-4e0d-90b4-a5e2aaceb6d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:34:01.540551 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b59e5a-8a93-4e0d-90b4-a5e2aaceb6d2 None admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:34:01.566456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 353/710] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:34:01 2022] POST /identity/v3/endpoints => generated 331 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:34:11.390802 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=69 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:34:11.558613 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:35:01.253388 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a98ddf-766b-4a8d-b63b-65620b95a5dd None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:01.253863 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a98ddf-766b-4a8d-b63b-65620b95a5dd None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:01.254084 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a98ddf-766b-4a8d-b63b-65620b95a5dd None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:01.256054 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 358/711] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:01.261085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dc65e-6b9e-45e5-b234-3369416de3b3 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:01.261503 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dc65e-6b9e-45e5-b234-3369416de3b3 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:01.261629 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151dc65e-6b9e-45e5-b234-3369416de3b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:01.281803 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-151dc65e-6b9e-45e5-b234-3369416de3b3 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:01.283197 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-151dc65e-6b9e-45e5-b234-3369416de3b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:01.358902 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 354/712] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:01.700123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf933a-e929-4056-bfac-2e420f1a35e3 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:01.700419 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf933a-e929-4056-bfac-2e420f1a35e3 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:01.700676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cf933a-e929-4056-bfac-2e420f1a35e3 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:01.701997 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 359/713] 10.222.0.39 () {54 vars in 964 bytes} [Sat Oct 22 20:35:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:01.708196 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdea1b2-a7cc-480f-86df-633902581f77 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:01.708481 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdea1b2-a7cc-480f-86df-633902581f77 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:01.708744 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdea1b2-a7cc-480f-86df-633902581f77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:01.765065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-8cdea1b2-a7cc-480f-86df-633902581f77 None None] MFA Rules not processed for user `7f526e9ac6094156aa57f280c4de4f29`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:01.766178 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-8cdea1b2-a7cc-480f-86df-633902581f77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:01.826810 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 355/714] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Oct 22 20:35:01 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:01.835874 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf933a-e929-4056-bfac-2e420f1a35e3 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:01.848048 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cf933a-e929-4056-bfac-2e420f1a35e3 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:01.851885 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c957faa2-aa71-44f3-8dd2-e6eed63d20ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:01.852569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957faa2-aa71-44f3-8dd2-e6eed63d20ad service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:01.852929 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957faa2-aa71-44f3-8dd2-e6eed63d20ad service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:01.853256 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c957faa2-aa71-44f3-8dd2-e6eed63d20ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:01.863840 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957faa2-aa71-44f3-8dd2-e6eed63d20ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:01.865419 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c957faa2-aa71-44f3-8dd2-e6eed63d20ad service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:01.876450 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 360/715] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:04.495029 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee626667-8188-4780-8f57-29bc293a3deb None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:04.495671 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee626667-8188-4780-8f57-29bc293a3deb None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:04.495671 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee626667-8188-4780-8f57-29bc293a3deb None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:04.497096 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 356/716] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:04.503176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090988d4-4598-4218-86e0-8d41d4b5de83 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:04.503724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090988d4-4598-4218-86e0-8d41d4b5de83 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:04.503962 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090988d4-4598-4218-86e0-8d41d4b5de83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:04.529413 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-090988d4-4598-4218-86e0-8d41d4b5de83 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:04.530635 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-090988d4-4598-4218-86e0-8d41d4b5de83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:04.539344 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 361/717] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:04.882155 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e7b3-ffbb-4ffe-98f2-7fe7d253d4ce None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:04.882539 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e7b3-ffbb-4ffe-98f2-7fe7d253d4ce None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:04.882873 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f87e7b3-ffbb-4ffe-98f2-7fe7d253d4ce None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:04.884462 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 357/718] 10.222.0.39 () {54 vars in 964 bytes} [Sat Oct 22 20:35:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:04.890468 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108fef4-624c-443f-9cec-566cafd519ab None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:04.890813 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108fef4-624c-443f-9cec-566cafd519ab None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:04.891151 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0108fef4-624c-443f-9cec-566cafd519ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:04.911555 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-0108fef4-624c-443f-9cec-566cafd519ab None None] MFA Rules not processed for user `7f526e9ac6094156aa57f280c4de4f29`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:04.912874 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-0108fef4-624c-443f-9cec-566cafd519ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:04.919743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 362/719] 10.222.0.39 () {58 vars in 1061 bytes} [Sat Oct 22 20:35:04 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:04.928801 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e7b3-ffbb-4ffe-98f2-7fe7d253d4ce None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:04.939986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f87e7b3-ffbb-4ffe-98f2-7fe7d253d4ce None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:04.943965 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e86c8-c88f-4886-b3e7-46dc5530fba3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:04.944659 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e86c8-c88f-4886-b3e7-46dc5530fba3 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:04.945026 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e86c8-c88f-4886-b3e7-46dc5530fba3 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:04.945386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e86c8-c88f-4886-b3e7-46dc5530fba3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:04.954594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e86c8-c88f-4886-b3e7-46dc5530fba3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:04.956160 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e86c8-c88f-4886-b3e7-46dc5530fba3 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:04.965888 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 358/720] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:07.875750 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e23b98-b2de-4208-995c-b22f0bf2d4cd None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:07.876728 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e23b98-b2de-4208-995c-b22f0bf2d4cd None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:07.877134 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e23b98-b2de-4208-995c-b22f0bf2d4cd None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:07.881593 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 363/721] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:07.884445 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9390ba-2081-47e1-94f0-e7b73de8bf85 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:07.884952 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9390ba-2081-47e1-94f0-e7b73de8bf85 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:07.885056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9390ba-2081-47e1-94f0-e7b73de8bf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:07.930610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-0a9390ba-2081-47e1-94f0-e7b73de8bf85 None None] MFA Rules not processed for user `fa13cec188244763b5255c20594ee3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:07.931888 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-0a9390ba-2081-47e1-94f0-e7b73de8bf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:07.974997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:35:08.008069 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 359/722] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:07 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:08.344283 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e23b98-b2de-4208-995c-b22f0bf2d4cd None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:08.356014 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e23b98-b2de-4208-995c-b22f0bf2d4cd None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:08.360148 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80549b6d-a524-4653-9cba-a0add71be465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:08.360825 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549b6d-a524-4653-9cba-a0add71be465 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:08.361156 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549b6d-a524-4653-9cba-a0add71be465 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:08.361343 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80549b6d-a524-4653-9cba-a0add71be465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:08.370485 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80549b6d-a524-4653-9cba-a0add71be465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:08.371928 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80549b6d-a524-4653-9cba-a0add71be465 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:08.381125 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 364/723] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:08 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:11.256310 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf952a-0cc4-4680-8bad-f62a40fc84dc None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:11.256878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf952a-0cc4-4680-8bad-f62a40fc84dc None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:11.256878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbf952a-0cc4-4680-8bad-f62a40fc84dc None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:11.258166 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 360/724] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:11.263594 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a4024-0b4d-4933-b009-1171efda2be1 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:11.264045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a4024-0b4d-4933-b009-1171efda2be1 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:11.264143 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a4024-0b4d-4933-b009-1171efda2be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:11.284383 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-ec0a4024-0b4d-4933-b009-1171efda2be1 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:11.285556 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-ec0a4024-0b4d-4933-b009-1171efda2be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:11.370622 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 365/725] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:11 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:11.700480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf952a-0cc4-4680-8bad-f62a40fc84dc None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:11.717262 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbf952a-0cc4-4680-8bad-f62a40fc84dc None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:11.723480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a6f356-0efe-4c5c-b43f-d199c3e45f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:11.724069 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6f356-0efe-4c5c-b43f-d199c3e45f59 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:11.724507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6f356-0efe-4c5c-b43f-d199c3e45f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:11.724879 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a6f356-0efe-4c5c-b43f-d199c3e45f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:11.736352 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6f356-0efe-4c5c-b43f-d199c3e45f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:11.737899 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a6f356-0efe-4c5c-b43f-d199c3e45f59 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:11.747830 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 361/726] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:11 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:14.736302 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bd9bf-4919-418f-807e-4de1f0c3da5e None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:14.736863 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bd9bf-4919-418f-807e-4de1f0c3da5e None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:14.736863 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617bd9bf-4919-418f-807e-4de1f0c3da5e None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:14.738149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 366/727] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:14.743423 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78f715-a203-4b2c-be08-f72ef0cf05bc None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:14.743838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78f715-a203-4b2c-be08-f72ef0cf05bc None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:14.743945 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78f715-a203-4b2c-be08-f72ef0cf05bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:14.764176 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-cc78f715-a203-4b2c-be08-f72ef0cf05bc None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:14.765367 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-cc78f715-a203-4b2c-be08-f72ef0cf05bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:14.774094 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 362/728] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:14 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:15.097637 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bd9bf-4919-418f-807e-4de1f0c3da5e None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:15.109244 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617bd9bf-4919-418f-807e-4de1f0c3da5e None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:15.112930 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ef171-974b-4498-9e25-c7e16356b875 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:15.113527 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ef171-974b-4498-9e25-c7e16356b875 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:15.113805 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ef171-974b-4498-9e25-c7e16356b875 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:15.114076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ef171-974b-4498-9e25-c7e16356b875 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:15.123489 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ef171-974b-4498-9e25-c7e16356b875 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:15.124906 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ef171-974b-4498-9e25-c7e16356b875 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:15.134514 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 367/729] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:15 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:17.537496 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486dfa4-3a29-42fb-b887-653ab660e3ac None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:17.538085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486dfa4-3a29-42fb-b887-653ab660e3ac None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:17.538085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a486dfa4-3a29-42fb-b887-653ab660e3ac None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:17.539417 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 363/730] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:17.544696 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6928a-d78e-4361-953e-d481e3bf9c82 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:17.545140 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6928a-d78e-4361-953e-d481e3bf9c82 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:17.545226 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6928a-d78e-4361-953e-d481e3bf9c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:17.564724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-bff6928a-d78e-4361-953e-d481e3bf9c82 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:17.565901 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-bff6928a-d78e-4361-953e-d481e3bf9c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:17.574036 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 368/731] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:17 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:17.907817 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486dfa4-3a29-42fb-b887-653ab660e3ac None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:17.920165 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a486dfa4-3a29-42fb-b887-653ab660e3ac None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:17.924304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f61a2-bcd9-4bdf-9bf1-fd93ab5dea52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:17.924885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f61a2-bcd9-4bdf-9bf1-fd93ab5dea52 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:17.925156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f61a2-bcd9-4bdf-9bf1-fd93ab5dea52 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:17.925425 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f61a2-bcd9-4bdf-9bf1-fd93ab5dea52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:17.936165 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f61a2-bcd9-4bdf-9bf1-fd93ab5dea52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:17.937598 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f61a2-bcd9-4bdf-9bf1-fd93ab5dea52 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:17.947595 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 364/732] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:17 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:20.345799 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6831578-64d6-49e8-bc42-966f4ef8e6e0 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:20.346323 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6831578-64d6-49e8-bc42-966f4ef8e6e0 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:20.346323 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6831578-64d6-49e8-bc42-966f4ef8e6e0 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:20.347580 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 369/733] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:20.352947 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bfd29-dd96-4380-b88c-7c5c3406ef70 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:20.353338 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bfd29-dd96-4380-b88c-7c5c3406ef70 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:20.353515 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7bfd29-dd96-4380-b88c-7c5c3406ef70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:20.374276 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-ff7bfd29-dd96-4380-b88c-7c5c3406ef70 None None] MFA Rules not processed for user `fa13cec188244763b5255c20594ee3b2`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:20.375505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-ff7bfd29-dd96-4380-b88c-7c5c3406ef70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:20.384408 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 365/734] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:20 2022] POST /identity/v3/auth/tokens => generated 2803 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:20.713928 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6831578-64d6-49e8-bc42-966f4ef8e6e0 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:20.725608 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6831578-64d6-49e8-bc42-966f4ef8e6e0 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:20.730006 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c02c58-0557-4de8-80a5-e002047a9de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:20.730620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c02c58-0557-4de8-80a5-e002047a9de7 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:20.730894 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c02c58-0557-4de8-80a5-e002047a9de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:20.731160 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c02c58-0557-4de8-80a5-e002047a9de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:20.741135 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c02c58-0557-4de8-80a5-e002047a9de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:20.742558 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c02c58-0557-4de8-80a5-e002047a9de7 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:20.751881 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 370/735] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:20 2022] GET /identity/v3/auth/tokens => generated 2803 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:23.350008 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039fb1f-d9a2-4abe-bd9f-deed40989004 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:23.350579 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039fb1f-d9a2-4abe-bd9f-deed40989004 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:23.350579 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b039fb1f-d9a2-4abe-bd9f-deed40989004 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:23.352161 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 366/736] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:23.357904 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1489-59ac-4fd2-90a5-d3ec042a91c9 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:23.358376 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1489-59ac-4fd2-90a5-d3ec042a91c9 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:23.358584 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c1489-59ac-4fd2-90a5-d3ec042a91c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:23.378357 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-eb2c1489-59ac-4fd2-90a5-d3ec042a91c9 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:23.379557 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-eb2c1489-59ac-4fd2-90a5-d3ec042a91c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:23.387800 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 371/737] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:23.724656 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039fb1f-d9a2-4abe-bd9f-deed40989004 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:23.735816 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b039fb1f-d9a2-4abe-bd9f-deed40989004 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:23.739285 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f208fcda-b85a-4ac4-9b04-a038856a66d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:23.739875 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208fcda-b85a-4ac4-9b04-a038856a66d5 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:23.740145 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208fcda-b85a-4ac4-9b04-a038856a66d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:23.740405 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f208fcda-b85a-4ac4-9b04-a038856a66d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:23.749211 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208fcda-b85a-4ac4-9b04-a038856a66d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:23.750589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f208fcda-b85a-4ac4-9b04-a038856a66d5 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:23.760162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 367/738] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:26.176519 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703832b-88ef-4f75-8a7d-88a1156a4443 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:26.177340 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703832b-88ef-4f75-8a7d-88a1156a4443 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:26.177340 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0703832b-88ef-4f75-8a7d-88a1156a4443 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:26.179428 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 372/739] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:26.188288 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877aae0-4df7-4ae2-bba2-d0d0584def6a None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:26.188959 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877aae0-4df7-4ae2-bba2-d0d0584def6a None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:26.189122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877aae0-4df7-4ae2-bba2-d0d0584def6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:26.214618 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-9877aae0-4df7-4ae2-bba2-d0d0584def6a None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:26.215849 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-9877aae0-4df7-4ae2-bba2-d0d0584def6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:26.225107 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 368/740] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:26.557615 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703832b-88ef-4f75-8a7d-88a1156a4443 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:26.569312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0703832b-88ef-4f75-8a7d-88a1156a4443 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:26.573209 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c662b9bb-0aed-49e5-a400-c017b7060a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:26.573797 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662b9bb-0aed-49e5-a400-c017b7060a20 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:26.574070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662b9bb-0aed-49e5-a400-c017b7060a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:26.574335 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c662b9bb-0aed-49e5-a400-c017b7060a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:26.583294 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662b9bb-0aed-49e5-a400-c017b7060a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:26.584732 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c662b9bb-0aed-49e5-a400-c017b7060a20 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:26.593822 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 373/741] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:29.590731 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc61c-9b5a-4978-8b7f-4f351b7123e0 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:29.591615 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc61c-9b5a-4978-8b7f-4f351b7123e0 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:29.591615 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61efc61c-9b5a-4978-8b7f-4f351b7123e0 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:29.593764 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 369/742] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:29.599208 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48e82-f47c-43c7-a2ae-17a107c63902 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:29.599677 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48e82-f47c-43c7-a2ae-17a107c63902 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:29.599764 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf48e82-f47c-43c7-a2ae-17a107c63902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:29.620213 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-acf48e82-f47c-43c7-a2ae-17a107c63902 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:29.622882 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-acf48e82-f47c-43c7-a2ae-17a107c63902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:29.631927 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 374/743] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:29 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:29.964762 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc61c-9b5a-4978-8b7f-4f351b7123e0 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:29.984101 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61efc61c-9b5a-4978-8b7f-4f351b7123e0 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:29.988754 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cba570-10f2-4993-8e26-9ccdd2ef9110 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:29.989339 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba570-10f2-4993-8e26-9ccdd2ef9110 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:29.989613 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba570-10f2-4993-8e26-9ccdd2ef9110 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:29.989874 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cba570-10f2-4993-8e26-9ccdd2ef9110 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:30.000072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cba570-10f2-4993-8e26-9ccdd2ef9110 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:30.001505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cba570-10f2-4993-8e26-9ccdd2ef9110 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:30.012276 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 370/744] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:29 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:34.285116 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca4571-8f44-4b88-bad0-fb21e2cb96af None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:34.285693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca4571-8f44-4b88-bad0-fb21e2cb96af None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:34.285693 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ca4571-8f44-4b88-bad0-fb21e2cb96af None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:34.286866 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 375/745] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:34.292272 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63989c-af45-4d9c-8b59-0ef777875436 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:34.292713 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63989c-af45-4d9c-8b59-0ef777875436 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:34.292925 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d63989c-af45-4d9c-8b59-0ef777875436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:34.312887 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-7d63989c-af45-4d9c-8b59-0ef777875436 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:34.314182 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-7d63989c-af45-4d9c-8b59-0ef777875436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:34.323051 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 371/746] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:34 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:34.655830 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca4571-8f44-4b88-bad0-fb21e2cb96af None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:34.661482 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=77 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:35:34.668151 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ca4571-8f44-4b88-bad0-fb21e2cb96af None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:34.672230 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b08ec13-795f-4125-8ca7-3d5caed2b00d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:34.672847 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ec13-795f-4125-8ca7-3d5caed2b00d service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:34.673108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ec13-795f-4125-8ca7-3d5caed2b00d service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:34.673392 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b08ec13-795f-4125-8ca7-3d5caed2b00d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:34.683602 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08ec13-795f-4125-8ca7-3d5caed2b00d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:34.685100 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b08ec13-795f-4125-8ca7-3d5caed2b00d service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:34.694979 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 376/747] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:34 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:37.621617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33612b-dc23-4ba9-bd2c-86e5b6ffa6e2 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:37.622151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33612b-dc23-4ba9-bd2c-86e5b6ffa6e2 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:37.622151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33612b-dc23-4ba9-bd2c-86e5b6ffa6e2 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:37.623446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 372/748] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:37.628814 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c884-d8dd-497a-8f8f-397d8c9019e4 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:37.629248 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c884-d8dd-497a-8f8f-397d8c9019e4 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:37.629334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c458c884-d8dd-497a-8f8f-397d8c9019e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:37.649647 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-c458c884-d8dd-497a-8f8f-397d8c9019e4 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:37.650769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-c458c884-d8dd-497a-8f8f-397d8c9019e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:37.659856 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 377/749] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:37 2022] POST /identity/v3/auth/tokens => generated 2798 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:37.997718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33612b-dc23-4ba9-bd2c-86e5b6ffa6e2 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:38.003553 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=48 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:35:38.010797 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33612b-dc23-4ba9-bd2c-86e5b6ffa6e2 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:38.015559 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a6c8af-2960-412f-9f58-3e518d71b6f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:38.016315 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6c8af-2960-412f-9f58-3e518d71b6f2 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:38.016692 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6c8af-2960-412f-9f58-3e518d71b6f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:38.017065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a6c8af-2960-412f-9f58-3e518d71b6f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:38.030084 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6c8af-2960-412f-9f58-3e518d71b6f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:38.031778 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a6c8af-2960-412f-9f58-3e518d71b6f2 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:38.042603 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 373/750] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:37 2022] GET /identity/v3/auth/tokens => generated 2798 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:42.458749 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e1fb4-4dac-484c-941d-0680f6729aa8 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:42.459226 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e1fb4-4dac-484c-941d-0680f6729aa8 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:42.459474 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44e1fb4-4dac-484c-941d-0680f6729aa8 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:42.460611 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 378/751] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:42.465996 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c0089-be8b-409f-9556-a127c46aa095 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:42.466741 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c0089-be8b-409f-9556-a127c46aa095 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:42.467019 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7c0089-be8b-409f-9556-a127c46aa095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:42.486676 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-de7c0089-be8b-409f-9556-a127c46aa095 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:42.488118 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-de7c0089-be8b-409f-9556-a127c46aa095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:42.496535 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 374/752] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:42 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:42.832710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e1fb4-4dac-484c-941d-0680f6729aa8 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:42.844542 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44e1fb4-4dac-484c-941d-0680f6729aa8 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:42.848670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4179bc8d-24cf-442d-8b51-5b7f022bfb10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:42.849262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179bc8d-24cf-442d-8b51-5b7f022bfb10 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:42.849534 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179bc8d-24cf-442d-8b51-5b7f022bfb10 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:42.849799 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4179bc8d-24cf-442d-8b51-5b7f022bfb10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:42.859089 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179bc8d-24cf-442d-8b51-5b7f022bfb10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:42.860660 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4179bc8d-24cf-442d-8b51-5b7f022bfb10 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:42.869947 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 379/753] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:42 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:35:48.244111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf974e56-070b-41d4-8681-7c2b4fabe2e3 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:48.244970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf974e56-070b-41d4-8681-7c2b4fabe2e3 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:48.245386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf974e56-070b-41d4-8681-7c2b4fabe2e3 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:48.247140 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 375/754] 10.222.0.39 () {54 vars in 921 bytes} [Sat Oct 22 20:35:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:48.252151 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283b23f-ffe8-4540-891e-3601e72c8453 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:48.252940 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283b23f-ffe8-4540-891e-3601e72c8453 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:48.253359 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283b23f-ffe8-4540-891e-3601e72c8453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:48.301290 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-8283b23f-ffe8-4540-891e-3601e72c8453 None None] MFA Rules not processed for user `9b73c8f104d7476294921098cec0a8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:48.302670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-8283b23f-ffe8-4540-891e-3601e72c8453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:48.381233 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 380/755] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Oct 22 20:35:48 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:52.482799 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=8 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:35:52.795373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f92de-630e-4eb8-a886-f040185970af None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:52.795829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f92de-630e-4eb8-a886-f040185970af None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:52.795946 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439f92de-630e-4eb8-a886-f040185970af None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:52.797581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 376/756] 10.222.0.39 () {54 vars in 921 bytes} [Sat Oct 22 20:35:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:52.803019 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b9a9-ddc9-4010-be31-765bd996b307 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:52.804046 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b9a9-ddc9-4010-be31-765bd996b307 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:52.804578 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d4b9a9-ddc9-4010-be31-765bd996b307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:52.827370 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-b5d4b9a9-ddc9-4010-be31-765bd996b307 None None] MFA Rules not processed for user `9b73c8f104d7476294921098cec0a8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:52.828914 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-b5d4b9a9-ddc9-4010-be31-765bd996b307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:52.838556 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 381/757] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Oct 22 20:35:52 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:54.282408 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcbf3e-7abf-4a12-958a-a402b9c5a77e None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:54.282997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcbf3e-7abf-4a12-958a-a402b9c5a77e None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:54.282997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bcbf3e-7abf-4a12-958a-a402b9c5a77e None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:54.284507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 377/758] 10.222.0.39 () {54 vars in 921 bytes} [Sat Oct 22 20:35:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:54.289581 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd754b7-43b6-4d5d-be27-b1981e5ae9b2 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:54.290014 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd754b7-43b6-4d5d-be27-b1981e5ae9b2 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:54.290127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd754b7-43b6-4d5d-be27-b1981e5ae9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:54.309776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-7dd754b7-43b6-4d5d-be27-b1981e5ae9b2 None None] MFA Rules not processed for user `9b73c8f104d7476294921098cec0a8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:54.310949 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-7dd754b7-43b6-4d5d-be27-b1981e5ae9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:54.320541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 382/759] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Oct 22 20:35:54 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:35:58.454880 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841bb8-6322-40f7-a478-b29f921ca96f None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:58.455470 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841bb8-6322-40f7-a478-b29f921ca96f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:58.455470 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d841bb8-6322-40f7-a478-b29f921ca96f None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:58.456762 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 378/760] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:35:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:58.462004 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd38cfa-2e6b-40e6-9c78-fdad46d3fad9 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:58.462423 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd38cfa-2e6b-40e6-9c78-fdad46d3fad9 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:58.462710 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd38cfa-2e6b-40e6-9c78-fdad46d3fad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:58.482273 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-0dd38cfa-2e6b-40e6-9c78-fdad46d3fad9 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:58.483636 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-0dd38cfa-2e6b-40e6-9c78-fdad46d3fad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:58.491439 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 383/761] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:35:58 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:35:58.833247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f7a32-6342-4589-93da-5c715b8a17fd None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:58.833926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f7a32-6342-4589-93da-5c715b8a17fd None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:58.834392 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f7a32-6342-4589-93da-5c715b8a17fd None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:58.836582 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 379/762] 10.222.0.39 () {54 vars in 961 bytes} [Sat Oct 22 20:35:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:35:58.846802 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84818834-6957-475d-afd3-65a0a39010a3 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:58.847623 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84818834-6957-475d-afd3-65a0a39010a3 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:58.848907 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84818834-6957-475d-afd3-65a0a39010a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:58.893056 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-84818834-6957-475d-afd3-65a0a39010a3 None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:35:58.894408 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-84818834-6957-475d-afd3-65a0a39010a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:35:58.961567 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:35:58.968083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 384/763] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Oct 22 20:35:58 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:35:58.975927 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f7a32-6342-4589-93da-5c715b8a17fd None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:35:58.990030 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f7a32-6342-4589-93da-5c715b8a17fd None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:35:58.994942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ceb0f6-bda3-4b8d-b0b2-2c13e0177120 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:35:58.995681 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceb0f6-bda3-4b8d-b0b2-2c13e0177120 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:35:58.996053 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceb0f6-bda3-4b8d-b0b2-2c13e0177120 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:35:58.996414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ceb0f6-bda3-4b8d-b0b2-2c13e0177120 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:35:59.006563 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ceb0f6-bda3-4b8d-b0b2-2c13e0177120 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:35:59.008313 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ceb0f6-bda3-4b8d-b0b2-2c13e0177120 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:35:59.021690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 380/764] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:35:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:01.647892 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3387a68-7d2d-4457-9fc2-cdedf9a0aabd None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:01.648455 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3387a68-7d2d-4457-9fc2-cdedf9a0aabd None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:01.648455 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3387a68-7d2d-4457-9fc2-cdedf9a0aabd None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:01.649669 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 385/765] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:01.654971 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944410a5-041d-49d1-b19e-b132b15c618f None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:01.655417 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944410a5-041d-49d1-b19e-b132b15c618f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:01.655514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944410a5-041d-49d1-b19e-b132b15c618f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:01.675140 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-944410a5-041d-49d1-b19e-b132b15c618f None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:01.676341 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-944410a5-041d-49d1-b19e-b132b15c618f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:01.684681 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 381/766] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:02.019911 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3387a68-7d2d-4457-9fc2-cdedf9a0aabd None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:02.035166 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3387a68-7d2d-4457-9fc2-cdedf9a0aabd None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:02.041108 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6574e202-b130-4361-b86f-23fad4dfc689 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:02.041701 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574e202-b130-4361-b86f-23fad4dfc689 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:02.041701 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574e202-b130-4361-b86f-23fad4dfc689 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:02.042132 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6574e202-b130-4361-b86f-23fad4dfc689 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:02.051078 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574e202-b130-4361-b86f-23fad4dfc689 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:02.052780 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6574e202-b130-4361-b86f-23fad4dfc689 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:02.081265 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 386/767] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:02 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:04.763128 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53877128-c0e3-4727-a239-0411f0009917 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:04.763743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53877128-c0e3-4727-a239-0411f0009917 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:04.763842 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53877128-c0e3-4727-a239-0411f0009917 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:04.765136 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 382/768] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:04.770568 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d124c-392c-4da6-83d4-d44a543195a0 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:04.771023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d124c-392c-4da6-83d4-d44a543195a0 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:04.771159 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1d124c-392c-4da6-83d4-d44a543195a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:04.792492 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-1e1d124c-392c-4da6-83d4-d44a543195a0 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:04.793670 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-1e1d124c-392c-4da6-83d4-d44a543195a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:04.801448 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 387/769] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:05.140116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b66b-ad46-4452-8fdf-3c5f100508fc None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:05.140646 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b66b-ad46-4452-8fdf-3c5f100508fc None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:05.141107 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b241b66b-ad46-4452-8fdf-3c5f100508fc None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:05.142646 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 383/770] 10.222.0.39 () {54 vars in 961 bytes} [Sat Oct 22 20:36:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:05.150672 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524cfc-fa25-43f2-9800-41a0f5c75dd1 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:05.151246 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524cfc-fa25-43f2-9800-41a0f5c75dd1 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:05.151664 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b524cfc-fa25-43f2-9800-41a0f5c75dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:05.175999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-5b524cfc-fa25-43f2-9800-41a0f5c75dd1 None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:05.178478 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-5b524cfc-fa25-43f2-9800-41a0f5c75dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:05.187065 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 388/771] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Oct 22 20:36:05 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:05.194642 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b66b-ad46-4452-8fdf-3c5f100508fc None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:05.210389 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b241b66b-ad46-4452-8fdf-3c5f100508fc None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:05.216740 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a9c911-9382-4549-b8c0-d79971a52952 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:05.217322 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9c911-9382-4549-b8c0-d79971a52952 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:05.217674 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9c911-9382-4549-b8c0-d79971a52952 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:05.218128 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a9c911-9382-4549-b8c0-d79971a52952 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:05.228073 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9c911-9382-4549-b8c0-d79971a52952 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:05.230607 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a9c911-9382-4549-b8c0-d79971a52952 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:05.241367 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 384/772] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 22 20:36:07.845837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ab0b3-5308-4efb-b232-ec7e61296629 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:07.846804 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ab0b3-5308-4efb-b232-ec7e61296629 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:07.847212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567ab0b3-5308-4efb-b232-ec7e61296629 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:07.849330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 389/773] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:07.855923 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c21f4-e413-4c5d-9045-34c08901c3c2 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:07.856978 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c21f4-e413-4c5d-9045-34c08901c3c2 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:07.857492 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2c21f4-e413-4c5d-9045-34c08901c3c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:07.879546 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-0b2c21f4-e413-4c5d-9045-34c08901c3c2 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:07.881227 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-0b2c21f4-e413-4c5d-9045-34c08901c3c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:07.890438 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 385/774] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:08.291809 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ab0b3-5308-4efb-b232-ec7e61296629 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:08.317842 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567ab0b3-5308-4efb-b232-ec7e61296629 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:08.327111 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b79381-6019-4ca6-97a3-4e5e1f0e91de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:08.327901 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79381-6019-4ca6-97a3-4e5e1f0e91de service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:08.328314 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79381-6019-4ca6-97a3-4e5e1f0e91de service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:08.328735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b79381-6019-4ca6-97a3-4e5e1f0e91de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:08.344131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b79381-6019-4ca6-97a3-4e5e1f0e91de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:08.346337 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b79381-6019-4ca6-97a3-4e5e1f0e91de service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:08.363433 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 390/775] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:08.727162 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee5a0d-86c9-494d-9d9d-0af2aa8f03b7 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:08.727384 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee5a0d-86c9-494d-9d9d-0af2aa8f03b7 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:08.727664 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dee5a0d-86c9-494d-9d9d-0af2aa8f03b7 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:08.729020 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 386/776] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:08.734618 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a0249-0c40-4e7c-a9fd-5f7bf8087c49 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:08.735134 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a0249-0c40-4e7c-a9fd-5f7bf8087c49 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:08.735446 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656a0249-0c40-4e7c-a9fd-5f7bf8087c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:08.755185 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-656a0249-0c40-4e7c-a9fd-5f7bf8087c49 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:08.756394 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-656a0249-0c40-4e7c-a9fd-5f7bf8087c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:08.764747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 391/777] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:08 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:09.143852 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bb178-b5ab-42d3-9289-bfb90f1e81a9 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:09.143852 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bb178-b5ab-42d3-9289-bfb90f1e81a9 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:09.143852 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290bb178-b5ab-42d3-9289-bfb90f1e81a9 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:09.146942 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 387/778] 10.222.0.39 () {54 vars in 963 bytes} [Sat Oct 22 20:36:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:09.152389 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fc50-68e0-44c5-a650-fc107485bfcb None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:09.152855 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fc50-68e0-44c5-a650-fc107485bfcb None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:09.153130 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8702fc50-68e0-44c5-a650-fc107485bfcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:09.192919 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-8702fc50-68e0-44c5-a650-fc107485bfcb None None] MFA Rules not processed for user `c0efaeef0d724cc69ce9daa0f70856d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:09.194305 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-8702fc50-68e0-44c5-a650-fc107485bfcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:09.257042 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 392/779] 10.222.0.39 () {58 vars in 1060 bytes} [Sat Oct 22 20:36:09 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:09.264622 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bb178-b5ab-42d3-9289-bfb90f1e81a9 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:09.275400 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290bb178-b5ab-42d3-9289-bfb90f1e81a9 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:09.278881 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac533888-0bd5-49b2-ad30-e747b3ab5dec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0efaeef0d724cc69ce9daa0f70856d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:09.279617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac533888-0bd5-49b2-ad30-e747b3ab5dec service cinder] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:09.279991 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac533888-0bd5-49b2-ad30-e747b3ab5dec service cinder] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:09.280366 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac533888-0bd5-49b2-ad30-e747b3ab5dec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:09.289220 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac533888-0bd5-49b2-ad30-e747b3ab5dec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:09.290755 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac533888-0bd5-49b2-ad30-e747b3ab5dec service cinder] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:09.300339 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 388/780] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:10.836766 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c641ac2-e18e-4628-95e9-2aeb08439024 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:10.837268 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c641ac2-e18e-4628-95e9-2aeb08439024 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:10.837268 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c641ac2-e18e-4628-95e9-2aeb08439024 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:10.838608 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 393/781] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:10.844281 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e76ed-55ff-4310-9070-e03188e98461 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:10.844845 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e76ed-55ff-4310-9070-e03188e98461 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:10.844958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e76ed-55ff-4310-9070-e03188e98461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:10.864216 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-148e76ed-55ff-4310-9070-e03188e98461 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:10.865418 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-148e76ed-55ff-4310-9070-e03188e98461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:10.873134 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 389/782] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:11.213387 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c641ac2-e18e-4628-95e9-2aeb08439024 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:11.227291 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c641ac2-e18e-4628-95e9-2aeb08439024 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:11.232928 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6f6923-87f7-4223-af90-16b4fe57fcda service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:11.233523 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6923-87f7-4223-af90-16b4fe57fcda service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:11.233797 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6923-87f7-4223-af90-16b4fe57fcda service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:11.234062 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6f6923-87f7-4223-af90-16b4fe57fcda service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:11.242854 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f6923-87f7-4223-af90-16b4fe57fcda service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:11.244464 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6f6923-87f7-4223-af90-16b4fe57fcda service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:11.254109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 394/783] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:13.679743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d745a62-d95e-4c14-91ab-bd9546e96f3e None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:13.680247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d745a62-d95e-4c14-91ab-bd9546e96f3e None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:13.680247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d745a62-d95e-4c14-91ab-bd9546e96f3e None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:13.681726 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 390/784] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:13.687036 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db717-33d4-479c-95a7-5629723f14f4 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:13.687873 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db717-33d4-479c-95a7-5629723f14f4 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:13.688246 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507db717-33d4-479c-95a7-5629723f14f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:13.707774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-507db717-33d4-479c-95a7-5629723f14f4 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:13.709046 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-507db717-33d4-479c-95a7-5629723f14f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:13.718197 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 395/785] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:14.052753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d745a62-d95e-4c14-91ab-bd9546e96f3e None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:14.066838 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d745a62-d95e-4c14-91ab-bd9546e96f3e None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:14.071617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4687ec-c0ff-46ef-b607-42ce6b23ed5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:14.072210 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4687ec-c0ff-46ef-b607-42ce6b23ed5b service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:14.072484 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4687ec-c0ff-46ef-b607-42ce6b23ed5b service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:14.072748 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4687ec-c0ff-46ef-b607-42ce6b23ed5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:14.081466 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4687ec-c0ff-46ef-b607-42ce6b23ed5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:14.083042 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4687ec-c0ff-46ef-b607-42ce6b23ed5b service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:14.092898 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 391/786] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:16.525387 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f89b5-118e-4373-af74-3603aad2b75c None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:16.525894 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f89b5-118e-4373-af74-3603aad2b75c None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:16.525894 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63f89b5-118e-4373-af74-3603aad2b75c None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:16.527123 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 396/787] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:16.532566 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2109-53d3-4dbc-945f-028888d34507 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:16.533003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2109-53d3-4dbc-945f-028888d34507 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:16.533169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd2109-53d3-4dbc-945f-028888d34507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:16.552610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-99cd2109-53d3-4dbc-945f-028888d34507 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:16.553742 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-99cd2109-53d3-4dbc-945f-028888d34507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:16.561885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 392/788] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:16.901387 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f89b5-118e-4373-af74-3603aad2b75c None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:16.915787 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63f89b5-118e-4373-af74-3603aad2b75c None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:16.921989 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9800317b-9c34-4c3f-a0cf-e45a22308a20 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:16.922594 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800317b-9c34-4c3f-a0cf-e45a22308a20 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:16.922864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800317b-9c34-4c3f-a0cf-e45a22308a20 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:16.923125 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9800317b-9c34-4c3f-a0cf-e45a22308a20 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:16.932308 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800317b-9c34-4c3f-a0cf-e45a22308a20 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:16.933881 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9800317b-9c34-4c3f-a0cf-e45a22308a20 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:16.944304 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 397/789] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:19.655807 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3b7f3-e6af-4ff2-a7d3-cf56e2e47894 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:19.656845 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3b7f3-e6af-4ff2-a7d3-cf56e2e47894 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:19.656845 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e3b7f3-e6af-4ff2-a7d3-cf56e2e47894 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:19.657764 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 393/790] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:36:19.663645 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4b1fc-5cc6-4d08-84b0-f0e469cd27ef None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:19.664127 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4b1fc-5cc6-4d08-84b0-f0e469cd27ef None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:19.664235 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee4b1fc-5cc6-4d08-84b0-f0e469cd27ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:19.685853 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-9ee4b1fc-5cc6-4d08-84b0-f0e469cd27ef None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:19.687608 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-9ee4b1fc-5cc6-4d08-84b0-f0e469cd27ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:19.696019 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 398/791] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:20.035897 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3b7f3-e6af-4ff2-a7d3-cf56e2e47894 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:20.052919 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e3b7f3-e6af-4ff2-a7d3-cf56e2e47894 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:20.060451 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e011e-ef26-409b-b720-1d275ae83ae6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:20.061362 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e011e-ef26-409b-b720-1d275ae83ae6 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:20.061856 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e011e-ef26-409b-b720-1d275ae83ae6 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:20.062319 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e011e-ef26-409b-b720-1d275ae83ae6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:20.075875 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e011e-ef26-409b-b720-1d275ae83ae6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:20.077568 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6e011e-ef26-409b-b720-1d275ae83ae6 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:20.099357 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 394/792] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:20 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:23.616381 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404a20a-f99d-41d8-b4be-d931f42bce32 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:23.617076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404a20a-f99d-41d8-b4be-d931f42bce32 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:23.617076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2404a20a-f99d-41d8-b4be-d931f42bce32 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:23.618216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 399/793] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:23.623625 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a4f96-bec8-40d1-9d5a-52a3a4c8f5a4 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:23.624153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a4f96-bec8-40d1-9d5a-52a3a4c8f5a4 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:23.624153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a4f96-bec8-40d1-9d5a-52a3a4c8f5a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:23.631710 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=43 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:36:23.645386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-b19a4f96-bec8-40d1-9d5a-52a3a4c8f5a4 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:23.646507 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-b19a4f96-bec8-40d1-9d5a-52a3a4c8f5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:23.654810 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 395/794] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:23 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:23.985252 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404a20a-f99d-41d8-b4be-d931f42bce32 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:24.001087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2404a20a-f99d-41d8-b4be-d931f42bce32 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:24.006078 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecee71b0-4ca7-4d02-9db3-bad90439b0c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:24.006684 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee71b0-4ca7-4d02-9db3-bad90439b0c2 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:24.006951 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee71b0-4ca7-4d02-9db3-bad90439b0c2 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:24.007189 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecee71b0-4ca7-4d02-9db3-bad90439b0c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:24.015886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee71b0-4ca7-4d02-9db3-bad90439b0c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:24.017654 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecee71b0-4ca7-4d02-9db3-bad90439b0c2 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:24.028171 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 400/795] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:23 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:25.251216 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb61801-fa23-48f7-a84e-0c5cb97048ab None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:25.251866 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb61801-fa23-48f7-a84e-0c5cb97048ab None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:25.251866 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb61801-fa23-48f7-a84e-0c5cb97048ab None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:25.253112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 396/796] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:25.258447 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f81ba6-8f8e-4fdb-b2a0-088971e81968 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:25.258916 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f81ba6-8f8e-4fdb-b2a0-088971e81968 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:25.259011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f81ba6-8f8e-4fdb-b2a0-088971e81968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:25.278287 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-e2f81ba6-8f8e-4fdb-b2a0-088971e81968 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:25.279470 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-e2f81ba6-8f8e-4fdb-b2a0-088971e81968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:25.287936 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 401/797] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:25 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:25.634349 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0438-5037-4d12-8d61-1e1cfca98f32 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:25.634590 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0438-5037-4d12-8d61-1e1cfca98f32 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:25.635226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bd0438-5037-4d12-8d61-1e1cfca98f32 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:25.636601 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 397/798] 10.222.0.39 () {54 vars in 962 bytes} [Sat Oct 22 20:36:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:25.642271 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479030a-4069-4ed9-9264-c21caa81d99f None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:25.642549 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479030a-4069-4ed9-9264-c21caa81d99f None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:25.642812 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479030a-4069-4ed9-9264-c21caa81d99f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:25.681133 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-a479030a-4069-4ed9-9264-c21caa81d99f None None] MFA Rules not processed for user `54a843b5fd164017b662b4a3eafc8ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:25.682313 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-a479030a-4069-4ed9-9264-c21caa81d99f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:25.702011 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=100 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:36:25.741444 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 402/799] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Oct 22 20:36:25 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:25.749163 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd0438-5037-4d12-8d61-1e1cfca98f32 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:25.760554 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bd0438-5037-4d12-8d61-1e1cfca98f32 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:25.764222 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36473a3-c8f5-4e9d-9ecd-f3b967819e9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a843b5fd164017b662b4a3eafc8ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:25.764809 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36473a3-c8f5-4e9d-9ecd-f3b967819e9b service glance] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:25.765083 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36473a3-c8f5-4e9d-9ecd-f3b967819e9b service glance] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:25.765345 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36473a3-c8f5-4e9d-9ecd-f3b967819e9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:25.775790 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36473a3-c8f5-4e9d-9ecd-f3b967819e9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:25.777320 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36473a3-c8f5-4e9d-9ecd-f3b967819e9b service glance] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:25.786835 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 398/800] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:26.446674 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7d62-3172-41fd-8ba9-a41dfc15f264 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:26.447295 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7d62-3172-41fd-8ba9-a41dfc15f264 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:26.447295 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7d62-3172-41fd-8ba9-a41dfc15f264 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:26.448592 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 403/801] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:26.454245 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8145ec7-61d0-49a1-8858-5a37974fe4e4 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:26.454743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8145ec7-61d0-49a1-8858-5a37974fe4e4 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:26.454833 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8145ec7-61d0-49a1-8858-5a37974fe4e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:26.476384 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-a8145ec7-61d0-49a1-8858-5a37974fe4e4 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:26.477501 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-a8145ec7-61d0-49a1-8858-5a37974fe4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:26.486711 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 399/802] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:26 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:26.827837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7d62-3172-41fd-8ba9-a41dfc15f264 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:26.842292 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7d62-3172-41fd-8ba9-a41dfc15f264 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:26.847623 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbb9cae-ae36-46b4-8a80-d4200a7de05b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:26.848231 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb9cae-ae36-46b4-8a80-d4200a7de05b service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:26.848505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb9cae-ae36-46b4-8a80-d4200a7de05b service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:26.848774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbb9cae-ae36-46b4-8a80-d4200a7de05b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:26.857737 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb9cae-ae36-46b4-8a80-d4200a7de05b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:26.859359 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbb9cae-ae36-46b4-8a80-d4200a7de05b service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:26.871957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 404/803] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:26 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:29.371456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a7bb6-3afd-49d1-b9b1-756a215356c6 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:29.372124 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a7bb6-3afd-49d1-b9b1-756a215356c6 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:29.372124 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22a7bb6-3afd-49d1-b9b1-756a215356c6 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:29.373340 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 400/804] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:29.378865 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dd363-78e1-4ef8-ab89-484a30913c05 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:29.379363 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dd363-78e1-4ef8-ab89-484a30913c05 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:29.379475 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61dd363-78e1-4ef8-ab89-484a30913c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:29.403627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-f61dd363-78e1-4ef8-ab89-484a30913c05 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:29.407080 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-f61dd363-78e1-4ef8-ab89-484a30913c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:29.415552 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 405/805] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:29 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:29.767505 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a7bb6-3afd-49d1-b9b1-756a215356c6 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:29.782287 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22a7bb6-3afd-49d1-b9b1-756a215356c6 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:29.787966 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f47407-f39f-41c2-9b61-cc3984b2cfc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:29.788605 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47407-f39f-41c2-9b61-cc3984b2cfc5 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:29.788881 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47407-f39f-41c2-9b61-cc3984b2cfc5 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:29.789328 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f47407-f39f-41c2-9b61-cc3984b2cfc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:29.798638 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47407-f39f-41c2-9b61-cc3984b2cfc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:29.800471 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f47407-f39f-41c2-9b61-cc3984b2cfc5 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:29.811392 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 401/806] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:29 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:32.395869 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf79d71-4c31-42ff-b469-a7e04687906c None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:32.395869 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf79d71-4c31-42ff-b469-a7e04687906c None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:32.395869 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf79d71-4c31-42ff-b469-a7e04687906c None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:32.395869 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 406/807] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:36:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:32.401662 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6515-9258-4964-9176-d3f6777ae4c6 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:32.402132 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6515-9258-4964-9176-d3f6777ae4c6 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:32.402226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dda6515-9258-4964-9176-d3f6777ae4c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:32.423031 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-4dda6515-9258-4964-9176-d3f6777ae4c6 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:32.425038 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-4dda6515-9258-4964-9176-d3f6777ae4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:32.435289 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 402/808] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:36:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:32.775949 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf79d71-4c31-42ff-b469-a7e04687906c None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:32.791671 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf79d71-4c31-42ff-b469-a7e04687906c None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:32.797296 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df8a8c-7e7a-4be0-8369-7ac6ac7f91a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:32.797891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df8a8c-7e7a-4be0-8369-7ac6ac7f91a9 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:32.798574 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df8a8c-7e7a-4be0-8369-7ac6ac7f91a9 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:32.798855 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df8a8c-7e7a-4be0-8369-7ac6ac7f91a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:32.807136 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df8a8c-7e7a-4be0-8369-7ac6ac7f91a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:32.808756 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df8a8c-7e7a-4be0-8369-7ac6ac7f91a9 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:32.819176 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 407/809] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:40.969714 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6404887-90de-49a4-bef6-7ad34df41189 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:40.970338 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6404887-90de-49a4-bef6-7ad34df41189 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:40.970338 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6404887-90de-49a4-bef6-7ad34df41189 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:40.971683 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 403/810] 10.222.0.39 () {54 vars in 918 bytes} [Sat Oct 22 20:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:40.978560 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849b991-5be1-4f0b-a7b0-cbe14492de81 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:40.978995 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849b991-5be1-4f0b-a7b0-cbe14492de81 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:40.979109 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d849b991-5be1-4f0b-a7b0-cbe14492de81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:41.001045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-d849b991-5be1-4f0b-a7b0-cbe14492de81 None None] MFA Rules not processed for user `9b73c8f104d7476294921098cec0a8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:41.002218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-d849b991-5be1-4f0b-a7b0-cbe14492de81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:41.012129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 408/811] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Oct 22 20:36:40 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:41.029208 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec29913-b835-4e46-ac4a-48cd1c4e75bd None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:41.029489 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec29913-b835-4e46-ac4a-48cd1c4e75bd None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:41.029743 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec29913-b835-4e46-ac4a-48cd1c4e75bd None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:41.031047 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 404/812] 10.222.0.39 () {54 vars in 918 bytes} [Sat Oct 22 20:36:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:41.035982 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d4aa2-37f8-42ee-9d50-ac369f060611 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:41.036258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d4aa2-37f8-42ee-9d50-ac369f060611 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:41.036520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d4aa2-37f8-42ee-9d50-ac369f060611 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:41.057210 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-bc1d4aa2-37f8-42ee-9d50-ac369f060611 None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:41.058384 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-bc1d4aa2-37f8-42ee-9d50-ac369f060611 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:41.068225 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 409/813] 10.222.0.39 () {58 vars in 1015 bytes} [Sat Oct 22 20:36:41 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:42.417596 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=20 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:36:43.856995 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52449df4-fc00-48a6-acb2-5386ee16e63c None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:43.858058 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52449df4-fc00-48a6-acb2-5386ee16e63c None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:43.858058 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52449df4-fc00-48a6-acb2-5386ee16e63c None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:43.860299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 405/814] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:36:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:43.866644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19d021-5ffa-40f2-a2ff-22f318362e83 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:43.867097 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19d021-5ffa-40f2-a2ff-22f318362e83 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:43.867207 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb19d021-5ffa-40f2-a2ff-22f318362e83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:43.890292 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-fb19d021-5ffa-40f2-a2ff-22f318362e83 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:43.891508 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-fb19d021-5ffa-40f2-a2ff-22f318362e83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:43.899873 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 410/815] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:36:43 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:44.236996 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52449df4-fc00-48a6-acb2-5386ee16e63c None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:44.251959 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52449df4-fc00-48a6-acb2-5386ee16e63c None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:44.257417 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416340b-2f4a-426b-9e0e-4e63b46d4bb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:44.258002 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416340b-2f4a-426b-9e0e-4e63b46d4bb0 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:44.258272 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416340b-2f4a-426b-9e0e-4e63b46d4bb0 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:44.258535 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416340b-2f4a-426b-9e0e-4e63b46d4bb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:44.266918 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416340b-2f4a-426b-9e0e-4e63b46d4bb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:44.268852 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2416340b-2f4a-426b-9e0e-4e63b46d4bb0 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:44.278221 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 406/816] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:44 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:45.995517 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab06e8-aa61-4aaa-a20e-03acd0582d82 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:45.996088 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab06e8-aa61-4aaa-a20e-03acd0582d82 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:45.996088 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dab06e8-aa61-4aaa-a20e-03acd0582d82 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:45.997346 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 411/817] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:36:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:46.002581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0de4c-642f-4c8f-b337-9ebfd4c22bfa None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:46.003035 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0de4c-642f-4c8f-b337-9ebfd4c22bfa None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:46.003127 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f0de4c-642f-4c8f-b337-9ebfd4c22bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:46.025071 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-d9f0de4c-642f-4c8f-b337-9ebfd4c22bfa None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:46.026253 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-d9f0de4c-642f-4c8f-b337-9ebfd4c22bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:46.036179 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 407/818] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:36:46 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:46.263731 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab06e8-aa61-4aaa-a20e-03acd0582d82 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:46.278689 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dab06e8-aa61-4aaa-a20e-03acd0582d82 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:46.284371 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9695afc-a9ac-462e-b642-46cda65a48f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:46.284941 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9695afc-a9ac-462e-b642-46cda65a48f6 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:46.285207 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9695afc-a9ac-462e-b642-46cda65a48f6 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:46.285468 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9695afc-a9ac-462e-b642-46cda65a48f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:46.294348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9695afc-a9ac-462e-b642-46cda65a48f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:46.295995 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9695afc-a9ac-462e-b642-46cda65a48f6 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:46.305815 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 412/819] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:46 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:47.989817 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877312-d83d-4033-b1f0-90d73cfe981f None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:47.991040 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877312-d83d-4033-b1f0-90d73cfe981f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:47.991040 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d877312-d83d-4033-b1f0-90d73cfe981f None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:47.992912 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 408/820] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:36:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:47.998801 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcf2f1-d779-4dfb-91fd-9caefdd0dba7 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:47.999619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcf2f1-d779-4dfb-91fd-9caefdd0dba7 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:47.999795 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbcf2f1-d779-4dfb-91fd-9caefdd0dba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:48.026717 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-6cbcf2f1-d779-4dfb-91fd-9caefdd0dba7 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:48.027971 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-6cbcf2f1-d779-4dfb-91fd-9caefdd0dba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:48.035858 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 413/821] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:36:47 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:48.202199 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877312-d83d-4033-b1f0-90d73cfe981f None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:48.217483 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d877312-d83d-4033-b1f0-90d73cfe981f None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:48.223104 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96350d2-bf8e-409c-afd4-2a8e08df9f2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:48.223720 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96350d2-bf8e-409c-afd4-2a8e08df9f2b service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:48.223989 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96350d2-bf8e-409c-afd4-2a8e08df9f2b service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:48.224250 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96350d2-bf8e-409c-afd4-2a8e08df9f2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:48.233574 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96350d2-bf8e-409c-afd4-2a8e08df9f2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:48.235232 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96350d2-bf8e-409c-afd4-2a8e08df9f2b service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:48.244706 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 409/822] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:48 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:49.869967 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1443351-1c1d-4c12-85d7-4fa08bdb9e56 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:49.870554 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1443351-1c1d-4c12-85d7-4fa08bdb9e56 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:49.870554 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1443351-1c1d-4c12-85d7-4fa08bdb9e56 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:49.872618 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 414/823] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:36:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:49.879776 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4eca-4e63-483f-a531-bd3b4228538b None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:49.880189 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4eca-4e63-483f-a531-bd3b4228538b None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:49.880296 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce4eca-4e63-483f-a531-bd3b4228538b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:49.909816 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-dbce4eca-4e63-483f-a531-bd3b4228538b None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:49.910993 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-dbce4eca-4e63-483f-a531-bd3b4228538b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:49.920540 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 410/824] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:36:49 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:50.077622 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1443351-1c1d-4c12-85d7-4fa08bdb9e56 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:50.097899 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1443351-1c1d-4c12-85d7-4fa08bdb9e56 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:50.104235 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec28484-5fec-4050-9251-cedecbc99cc7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:50.104823 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec28484-5fec-4050-9251-cedecbc99cc7 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:50.105092 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec28484-5fec-4050-9251-cedecbc99cc7 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:50.105661 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec28484-5fec-4050-9251-cedecbc99cc7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:50.115475 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec28484-5fec-4050-9251-cedecbc99cc7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:50.117656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec28484-5fec-4050-9251-cedecbc99cc7 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:50.128220 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 415/825] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:51.764612 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6871c-ab45-4614-bb95-11c025cd0840 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:51.765646 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6871c-ab45-4614-bb95-11c025cd0840 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:51.765646 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a6871c-ab45-4614-bb95-11c025cd0840 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:51.767056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 411/826] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:36:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:51.772245 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602533a-b027-42c4-8834-3debbed20982 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:51.772684 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602533a-b027-42c4-8834-3debbed20982 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:51.772794 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c602533a-b027-42c4-8834-3debbed20982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:51.792858 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-c602533a-b027-42c4-8834-3debbed20982 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:51.794032 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-c602533a-b027-42c4-8834-3debbed20982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:51.803471 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 416/827] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:36:51 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:51.958428 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6871c-ab45-4614-bb95-11c025cd0840 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:51.973397 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a6871c-ab45-4614-bb95-11c025cd0840 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:51.979594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f86df-06f8-41f7-9418-59d4264748f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:51.980178 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f86df-06f8-41f7-9418-59d4264748f8 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:51.980778 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f86df-06f8-41f7-9418-59d4264748f8 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:51.981044 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f86df-06f8-41f7-9418-59d4264748f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:51.989610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f86df-06f8-41f7-9418-59d4264748f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:51.991179 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481f86df-06f8-41f7-9418-59d4264748f8 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:52.000596 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 412/828] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:51 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:53.583887 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a230ae1-f591-4b8f-9669-6cc751f8e34d None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:53.584771 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a230ae1-f591-4b8f-9669-6cc751f8e34d None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:53.584771 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a230ae1-f591-4b8f-9669-6cc751f8e34d None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:53.586809 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 417/829] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:36:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:53.594852 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9671-1ab2-4a3c-b9e8-416eb8c3021b None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:53.595280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9671-1ab2-4a3c-b9e8-416eb8c3021b None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:53.595414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-372b9671-1ab2-4a3c-b9e8-416eb8c3021b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:53.616023 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-372b9671-1ab2-4a3c-b9e8-416eb8c3021b None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:53.617201 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-372b9671-1ab2-4a3c-b9e8-416eb8c3021b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:53.625970 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 413/830] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:36:53 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:53.782350 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a230ae1-f591-4b8f-9669-6cc751f8e34d None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:53.805269 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a230ae1-f591-4b8f-9669-6cc751f8e34d None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:53.813839 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e059967-b986-4ecb-978d-046f9627bbca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:53.814437 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059967-b986-4ecb-978d-046f9627bbca service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:53.814711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059967-b986-4ecb-978d-046f9627bbca service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:53.814976 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e059967-b986-4ecb-978d-046f9627bbca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:53.823343 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e059967-b986-4ecb-978d-046f9627bbca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:53.824908 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e059967-b986-4ecb-978d-046f9627bbca service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:53.834472 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 418/831] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:53 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:55.400723 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf0db4-57f0-4bd6-bac1-5bc91fc0454d None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:55.401192 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf0db4-57f0-4bd6-bac1-5bc91fc0454d None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:55.401309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cf0db4-57f0-4bd6-bac1-5bc91fc0454d None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:55.402605 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 414/832] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:36:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:55.407988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d34a0-b919-40fe-83d4-ce68b9d79fac None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:55.408438 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d34a0-b919-40fe-83d4-ce68b9d79fac None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:55.408540 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d34a0-b919-40fe-83d4-ce68b9d79fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:55.428682 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-1a6d34a0-b919-40fe-83d4-ce68b9d79fac None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:55.429847 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-1a6d34a0-b919-40fe-83d4-ce68b9d79fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:55.438403 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 419/833] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:36:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:55.597936 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf0db4-57f0-4bd6-bac1-5bc91fc0454d None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:55.613905 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cf0db4-57f0-4bd6-bac1-5bc91fc0454d None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:55.619681 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a38e3bf-008f-4233-876e-936f5289f06f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:55.620269 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e3bf-008f-4233-876e-936f5289f06f service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:55.620539 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e3bf-008f-4233-876e-936f5289f06f service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:55.620807 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a38e3bf-008f-4233-876e-936f5289f06f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:55.629148 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38e3bf-008f-4233-876e-936f5289f06f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:55.630740 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a38e3bf-008f-4233-876e-936f5289f06f service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:55.640183 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 415/834] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:55 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:57.209627 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712cb4c-c9ab-42a1-8d94-a6d24e2e3799 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:57.210188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712cb4c-c9ab-42a1-8d94-a6d24e2e3799 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:57.210188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c712cb4c-c9ab-42a1-8d94-a6d24e2e3799 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:57.211524 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 420/835] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:36:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:57.217430 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444624-3d8e-4a7a-a44c-88b9b9f2b8ac None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:57.218130 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444624-3d8e-4a7a-a44c-88b9b9f2b8ac None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:57.218280 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73444624-3d8e-4a7a-a44c-88b9b9f2b8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:57.244414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-73444624-3d8e-4a7a-a44c-88b9b9f2b8ac None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:57.245608 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-73444624-3d8e-4a7a-a44c-88b9b9f2b8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:57.254273 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 416/836] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:36:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:57.410021 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712cb4c-c9ab-42a1-8d94-a6d24e2e3799 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:57.422816 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=67 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:36:57.432507 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c712cb4c-c9ab-42a1-8d94-a6d24e2e3799 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:57.438077 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd030879-4727-4c3c-adc5-0476e3b2615f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:57.438669 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd030879-4727-4c3c-adc5-0476e3b2615f service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:57.438944 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd030879-4727-4c3c-adc5-0476e3b2615f service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:57.439204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd030879-4727-4c3c-adc5-0476e3b2615f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:57.447213 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd030879-4727-4c3c-adc5-0476e3b2615f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:57.448818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd030879-4727-4c3c-adc5-0476e3b2615f service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:57.458519 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 421/837] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:57 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:36:59.039629 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52a2f-5e0a-47bf-b988-b0a167976cee None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:59.040209 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52a2f-5e0a-47bf-b988-b0a167976cee None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:59.040209 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d52a2f-5e0a-47bf-b988-b0a167976cee None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:59.041530 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 417/838] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:36:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:36:59.047594 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ef017-40e4-469e-afd1-d81ceee468f7 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:59.048292 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ef017-40e4-469e-afd1-d81ceee468f7 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:59.048477 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ef017-40e4-469e-afd1-d81ceee468f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:59.071735 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-3f3ef017-40e4-469e-afd1-d81ceee468f7 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:36:59.072921 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-3f3ef017-40e4-469e-afd1-d81ceee468f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:36:59.081142 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 422/839] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:36:59 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:36:59.236837 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52a2f-5e0a-47bf-b988-b0a167976cee None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:36:59.252733 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d52a2f-5e0a-47bf-b988-b0a167976cee None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:36:59.258794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18e8873-6917-4e10-9a05-163e0ecf4fa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:36:59.259405 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8873-6917-4e10-9a05-163e0ecf4fa2 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:36:59.259677 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8873-6917-4e10-9a05-163e0ecf4fa2 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:36:59.259944 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18e8873-6917-4e10-9a05-163e0ecf4fa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:36:59.268870 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e8873-6917-4e10-9a05-163e0ecf4fa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:36:59.270486 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18e8873-6917-4e10-9a05-163e0ecf4fa2 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:36:59.279702 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 418/840] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:36:59 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:01.565797 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394398fe-8eb2-4054-8631-5e1719a373e7 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:01.566373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394398fe-8eb2-4054-8631-5e1719a373e7 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:01.566373 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394398fe-8eb2-4054-8631-5e1719a373e7 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:01.567658 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 423/841] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:01.573573 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0359-be6e-40ab-a387-88259be49367 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:01.574040 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0359-be6e-40ab-a387-88259be49367 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:01.574135 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0359-be6e-40ab-a387-88259be49367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:01.596684 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-687d0359-be6e-40ab-a387-88259be49367 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:01.597868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-687d0359-be6e-40ab-a387-88259be49367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:01.607684 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 419/842] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:01 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:01.941377 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394398fe-8eb2-4054-8631-5e1719a373e7 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:01.953795 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394398fe-8eb2-4054-8631-5e1719a373e7 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:01.958544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604779f6-bbf0-4002-af4c-4d5f62ed136e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:01.959131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604779f6-bbf0-4002-af4c-4d5f62ed136e service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:01.959441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604779f6-bbf0-4002-af4c-4d5f62ed136e service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:01.959707 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604779f6-bbf0-4002-af4c-4d5f62ed136e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:01.970195 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604779f6-bbf0-4002-af4c-4d5f62ed136e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:01.971699 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604779f6-bbf0-4002-af4c-4d5f62ed136e service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:01.981334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 424/843] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:04.509422 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0451ce-7160-4804-b5e3-1c37216101fb None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:04.509965 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0451ce-7160-4804-b5e3-1c37216101fb None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:04.509965 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0451ce-7160-4804-b5e3-1c37216101fb None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:04.511286 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 420/844] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:04.517832 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7a07b-6179-462c-9a3b-c1b688869444 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:04.518293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7a07b-6179-462c-9a3b-c1b688869444 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:04.518414 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd7a07b-6179-462c-9a3b-c1b688869444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:04.547814 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-9dd7a07b-6179-462c-9a3b-c1b688869444 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:04.548997 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-9dd7a07b-6179-462c-9a3b-c1b688869444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:04.556784 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 425/845] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:04.890510 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0451ce-7160-4804-b5e3-1c37216101fb None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:04.908641 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0451ce-7160-4804-b5e3-1c37216101fb None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:04.912794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855a6d0b-3926-4205-aea9-45a6faa6108f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:04.913381 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a6d0b-3926-4205-aea9-45a6faa6108f service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:04.913641 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a6d0b-3926-4205-aea9-45a6faa6108f service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:04.913910 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855a6d0b-3926-4205-aea9-45a6faa6108f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:04.923138 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a6d0b-3926-4205-aea9-45a6faa6108f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:04.924678 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855a6d0b-3926-4205-aea9-45a6faa6108f service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:04.934607 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 421/846] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:07.631747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389995e-c345-4edf-ae6b-e4d675b850b4 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:07.632332 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389995e-c345-4edf-ae6b-e4d675b850b4 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:07.632332 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3389995e-c345-4edf-ae6b-e4d675b850b4 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:07.633622 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 426/847] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:07.642193 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7002d-85c9-4ae7-8675-f338d0c91ef7 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:07.642630 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7002d-85c9-4ae7-8675-f338d0c91ef7 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:07.642726 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7002d-85c9-4ae7-8675-f338d0c91ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:07.663589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-96a7002d-85c9-4ae7-8675-f338d0c91ef7 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:07.664686 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-96a7002d-85c9-4ae7-8675-f338d0c91ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:07.673357 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 422/848] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:07 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:08.014147 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389995e-c345-4edf-ae6b-e4d675b850b4 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:08.032636 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3389995e-c345-4edf-ae6b-e4d675b850b4 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:08.037162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1587c7-3d28-44df-8667-b44bdf02ddd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:08.037754 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1587c7-3d28-44df-8667-b44bdf02ddd9 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:08.038028 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1587c7-3d28-44df-8667-b44bdf02ddd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:08.038293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1587c7-3d28-44df-8667-b44bdf02ddd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:08.047572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1587c7-3d28-44df-8667-b44bdf02ddd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:08.049001 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1587c7-3d28-44df-8667-b44bdf02ddd9 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:08.058431 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 427/849] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:08 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:10.586311 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03721-3d41-417e-8a2d-b3c43bb08b4e None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:10.586862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03721-3d41-417e-8a2d-b3c43bb08b4e None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:10.586862 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b03721-3d41-417e-8a2d-b3c43bb08b4e None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:10.588297 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 423/850] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:10.594024 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4370a1-4a35-4b7e-ab07-b59716a58f98 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:10.594491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4370a1-4a35-4b7e-ab07-b59716a58f98 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:10.594584 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4370a1-4a35-4b7e-ab07-b59716a58f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:10.615027 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-dd4370a1-4a35-4b7e-ab07-b59716a58f98 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:10.616245 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-dd4370a1-4a35-4b7e-ab07-b59716a58f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:10.625320 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 428/851] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:10 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:10.954633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b03721-3d41-417e-8a2d-b3c43bb08b4e None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:10.972393 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b03721-3d41-417e-8a2d-b3c43bb08b4e None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:10.976587 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9854345-93c5-425f-a633-4bb45d4eda92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:10.977171 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854345-93c5-425f-a633-4bb45d4eda92 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:10.977438 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854345-93c5-425f-a633-4bb45d4eda92 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:10.977699 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9854345-93c5-425f-a633-4bb45d4eda92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:10.987747 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9854345-93c5-425f-a633-4bb45d4eda92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:10.989172 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9854345-93c5-425f-a633-4bb45d4eda92 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:10.998722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 424/852] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:13.507103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847346f-3dc6-4363-b8e6-be3a15263847 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:13.507729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847346f-3dc6-4363-b8e6-be3a15263847 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:13.507729 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a847346f-3dc6-4363-b8e6-be3a15263847 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:13.509001 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 429/853] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:13.515323 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475aab67-6563-4625-a41c-07df10fb3808 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:13.515893 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475aab67-6563-4625-a41c-07df10fb3808 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:13.516072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475aab67-6563-4625-a41c-07df10fb3808 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:13.524454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=61 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:37:13.541691 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-475aab67-6563-4625-a41c-07df10fb3808 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:13.542881 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-475aab67-6563-4625-a41c-07df10fb3808 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:13.552183 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 425/854] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:13.887388 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847346f-3dc6-4363-b8e6-be3a15263847 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:13.905737 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a847346f-3dc6-4363-b8e6-be3a15263847 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:13.909552 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2bb2e-5398-483a-b3d3-374d69e742a2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:13.910139 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2bb2e-5398-483a-b3d3-374d69e742a2 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:13.910412 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2bb2e-5398-483a-b3d3-374d69e742a2 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:13.910678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2bb2e-5398-483a-b3d3-374d69e742a2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:13.919475 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2bb2e-5398-483a-b3d3-374d69e742a2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:13.920884 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2bb2e-5398-483a-b3d3-374d69e742a2 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:13.930131 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 430/855] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:13 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:16.379909 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89343542-538a-4a29-a746-b1588e2f98d7 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:16.380533 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89343542-538a-4a29-a746-b1588e2f98d7 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:16.380533 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89343542-538a-4a29-a746-b1588e2f98d7 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:16.381809 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 426/856] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:16.387419 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38dcd9-19fb-4469-8a9b-a4c9c29b191f None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:16.387882 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38dcd9-19fb-4469-8a9b-a4c9c29b191f None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:16.387986 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe38dcd9-19fb-4469-8a9b-a4c9c29b191f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:16.410541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-fe38dcd9-19fb-4469-8a9b-a4c9c29b191f None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:16.411765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-fe38dcd9-19fb-4469-8a9b-a4c9c29b191f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:16.420441 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 431/857] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:16 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:16.756711 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89343542-538a-4a29-a746-b1588e2f98d7 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:16.768890 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89343542-538a-4a29-a746-b1588e2f98d7 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:16.772782 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596547dd-92ff-4bda-a637-07f199bb0d47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:16.773371 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596547dd-92ff-4bda-a637-07f199bb0d47 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:16.773650 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596547dd-92ff-4bda-a637-07f199bb0d47 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:16.773921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596547dd-92ff-4bda-a637-07f199bb0d47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:16.783184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596547dd-92ff-4bda-a637-07f199bb0d47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:16.784645 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596547dd-92ff-4bda-a637-07f199bb0d47 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:16.794180 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 427/858] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:16 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:19.298683 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d46a-8c91-402a-8fb3-2374b0ea84c7 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:19.299413 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d46a-8c91-402a-8fb3-2374b0ea84c7 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:19.299413 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5d46a-8c91-402a-8fb3-2374b0ea84c7 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:19.300573 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 432/859] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:19.307044 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb35b51-a246-4c59-99de-5e87f149ecf1 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:19.307868 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb35b51-a246-4c59-99de-5e87f149ecf1 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:19.308023 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb35b51-a246-4c59-99de-5e87f149ecf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:19.329890 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-9eb35b51-a246-4c59-99de-5e87f149ecf1 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:19.331115 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-9eb35b51-a246-4c59-99de-5e87f149ecf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:19.340376 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 428/860] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:19 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:19.668672 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d46a-8c91-402a-8fb3-2374b0ea84c7 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:19.681434 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5d46a-8c91-402a-8fb3-2374b0ea84c7 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:19.685508 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0a3cc-2fef-4929-abc0-fee3463e937a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:19.686093 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a3cc-2fef-4929-abc0-fee3463e937a service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:19.686361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a3cc-2fef-4929-abc0-fee3463e937a service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:19.686620 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0a3cc-2fef-4929-abc0-fee3463e937a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:19.696566 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0a3cc-2fef-4929-abc0-fee3463e937a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:19.698142 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0a3cc-2fef-4929-abc0-fee3463e937a service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:19.708020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 433/861] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:19 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:22.127728 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ffad5-bd47-4aa9-af36-1340e7375a76 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:22.128515 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ffad5-bd47-4aa9-af36-1340e7375a76 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:22.128515 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ffad5-bd47-4aa9-af36-1340e7375a76 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:22.129734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 429/862] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:22.136037 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c190-9b0d-4172-8ea7-e149223c4336 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:22.136502 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c190-9b0d-4172-8ea7-e149223c4336 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:22.136611 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a95c190-9b0d-4172-8ea7-e149223c4336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:22.163892 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-8a95c190-9b0d-4172-8ea7-e149223c4336 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:22.165069 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-8a95c190-9b0d-4172-8ea7-e149223c4336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:22.173754 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 434/863] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:22 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:37:22.504052 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ffad5-bd47-4aa9-af36-1340e7375a76 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:22.516247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ffad5-bd47-4aa9-af36-1340e7375a76 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:22.520438 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec1dac-14d5-4b53-ae7e-cab4c89f3871 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:22.521020 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1dac-14d5-4b53-ae7e-cab4c89f3871 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:22.521291 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1dac-14d5-4b53-ae7e-cab4c89f3871 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:22.521552 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec1dac-14d5-4b53-ae7e-cab4c89f3871 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:22.531287 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1dac-14d5-4b53-ae7e-cab4c89f3871 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:22.532707 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec1dac-14d5-4b53-ae7e-cab4c89f3871 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:22.544995 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 430/864] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:22 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:24.942665 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3c630-419f-45e7-8c65-37d357d5b5f2 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:24.943587 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3c630-419f-45e7-8c65-37d357d5b5f2 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:24.943587 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca3c630-419f-45e7-8c65-37d357d5b5f2 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:24.945699 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 435/865] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:24.954144 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7af5-aca8-424f-92d9-5b7e525399c9 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:24.954591 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7af5-aca8-424f-92d9-5b7e525399c9 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:24.954724 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325a7af5-aca8-424f-92d9-5b7e525399c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:24.975026 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-325a7af5-aca8-424f-92d9-5b7e525399c9 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:24.976249 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-325a7af5-aca8-424f-92d9-5b7e525399c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:24.985370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 431/866] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:24 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:37:25.320521 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3c630-419f-45e7-8c65-37d357d5b5f2 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:25.339062 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca3c630-419f-45e7-8c65-37d357d5b5f2 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:25.344717 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02eafa8-4e2b-4211-83c2-532a191f836e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:25.345306 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eafa8-4e2b-4211-83c2-532a191f836e service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:25.345575 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eafa8-4e2b-4211-83c2-532a191f836e service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:25.345835 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02eafa8-4e2b-4211-83c2-532a191f836e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:25.355117 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02eafa8-4e2b-4211-83c2-532a191f836e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:25.356881 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02eafa8-4e2b-4211-83c2-532a191f836e service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:25.366527 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 436/867] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:25 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:27.775885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae486ef9-262c-4b5a-aff7-da7cb45a76a5 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:27.776468 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae486ef9-262c-4b5a-aff7-da7cb45a76a5 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:27.776468 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae486ef9-262c-4b5a-aff7-da7cb45a76a5 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:27.778446 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 432/868] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:37:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:27.787496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce80c-d4b5-461e-b3f2-8965fe1dd390 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:27.787912 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce80c-d4b5-461e-b3f2-8965fe1dd390 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:27.788097 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ce80c-d4b5-461e-b3f2-8965fe1dd390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:27.799013 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=51 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:37:27.812442 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-e54ce80c-d4b5-461e-b3f2-8965fe1dd390 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:27.813640 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-e54ce80c-d4b5-461e-b3f2-8965fe1dd390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:27.822798 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 437/869] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:37:27 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:28.152231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae486ef9-262c-4b5a-aff7-da7cb45a76a5 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:28.166543 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae486ef9-262c-4b5a-aff7-da7cb45a76a5 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:28.170755 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd88871-ea6a-4e1e-98bb-e24ec3181654 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:28.171389 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd88871-ea6a-4e1e-98bb-e24ec3181654 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:28.171658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd88871-ea6a-4e1e-98bb-e24ec3181654 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:28.171937 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd88871-ea6a-4e1e-98bb-e24ec3181654 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:28.181688 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd88871-ea6a-4e1e-98bb-e24ec3181654 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:28.183127 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd88871-ea6a-4e1e-98bb-e24ec3181654 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:28.192833 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 433/870] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:37.807445 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=2 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:37:38.189331 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=26 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:37:52.273215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae059-314b-4373-8f50-7d5532b4e7dd None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:52.274218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae059-314b-4373-8f50-7d5532b4e7dd None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:52.274218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25ae059-314b-4373-8f50-7d5532b4e7dd None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:52.276197 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 438/871] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:37:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:52.284059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3edf2-bcea-49d4-bde8-2eca412bb91f None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:52.284501 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3edf2-bcea-49d4-bde8-2eca412bb91f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:52.284635 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3edf2-bcea-49d4-bde8-2eca412bb91f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:52.309113 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-eff3edf2-bcea-49d4-bde8-2eca412bb91f None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:52.310309 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-eff3edf2-bcea-49d4-bde8-2eca412bb91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:52.320827 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 434/872] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:37:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:52.665195 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df93ea2-8b4a-4e1a-9602-b872294b6396 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:52.665476 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df93ea2-8b4a-4e1a-9602-b872294b6396 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:52.665742 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df93ea2-8b4a-4e1a-9602-b872294b6396 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:52.667086 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 439/873] 10.222.0.39 () {54 vars in 962 bytes} [Sat Oct 22 20:37:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:52.672809 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344389c-6e91-4f7c-9f3c-50a422e06f71 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:52.673054 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344389c-6e91-4f7c-9f3c-50a422e06f71 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:52.673373 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344389c-6e91-4f7c-9f3c-50a422e06f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:52.693928 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-5344389c-6e91-4f7c-9f3c-50a422e06f71 None None] MFA Rules not processed for user `54a843b5fd164017b662b4a3eafc8ac0`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:52.695115 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-5344389c-6e91-4f7c-9f3c-50a422e06f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:52.702396 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 435/874] 10.222.0.39 () {58 vars in 1059 bytes} [Sat Oct 22 20:37:52 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:52.709773 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df93ea2-8b4a-4e1a-9602-b872294b6396 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:52.720976 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df93ea2-8b4a-4e1a-9602-b872294b6396 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:52.725262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b97be0-79d4-4e2b-9b3d-e5257011fa86 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a843b5fd164017b662b4a3eafc8ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:52.725847 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b97be0-79d4-4e2b-9b3d-e5257011fa86 service glance] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:52.726116 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b97be0-79d4-4e2b-9b3d-e5257011fa86 service glance] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:52.726382 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b97be0-79d4-4e2b-9b3d-e5257011fa86 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:52.736697 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b97be0-79d4-4e2b-9b3d-e5257011fa86 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:52.738083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b97be0-79d4-4e2b-9b3d-e5257011fa86 service glance] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:52.747933 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 440/875] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:37:55.215110 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb6f53-d8e6-4ea0-945c-69f35e584705 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:55.215690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb6f53-d8e6-4ea0-945c-69f35e584705 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:55.215690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eb6f53-d8e6-4ea0-945c-69f35e584705 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:55.217062 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 436/876] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:55.222727 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa30ac-15fe-42b0-98dd-c0f79895b1c7 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:55.223119 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa30ac-15fe-42b0-98dd-c0f79895b1c7 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:55.223283 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fa30ac-15fe-42b0-98dd-c0f79895b1c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:55.244031 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-58fa30ac-15fe-42b0-98dd-c0f79895b1c7 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:55.245206 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-58fa30ac-15fe-42b0-98dd-c0f79895b1c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:55.254748 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 441/877] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:37:55 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:55.573183 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb6f53-d8e6-4ea0-945c-69f35e584705 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:55.589956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eb6f53-d8e6-4ea0-945c-69f35e584705 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:55.596387 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd9beb8-41cf-4cde-847d-9c0dccb17f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:55.596975 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9beb8-41cf-4cde-847d-9c0dccb17f08 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:55.597242 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9beb8-41cf-4cde-847d-9c0dccb17f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:55.597485 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd9beb8-41cf-4cde-847d-9c0dccb17f08 admin admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:55.598112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9beb8-41cf-4cde-847d-9c0dccb17f08 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:55.599215 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING py.warnings [None req-2bd9beb8-41cf-4cde-847d-9c0dccb17f08 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:37:55.599215 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: warnings.warn(msg) Oct 22 20:37:55.599215 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: Oct 22 20:37:55.600376 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd9beb8-41cf-4cde-847d-9c0dccb17f08 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:55.619123 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 437/878] 10.222.0.39 () {56 vars in 1108 bytes} [Sat Oct 22 20:37:55 2022] GET /identity/v3/projects => generated 1606 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:37:57.987318 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963d69-3611-4c10-a9a6-3eb3558c3930 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:57.988212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963d69-3611-4c10-a9a6-3eb3558c3930 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:57.988212 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba963d69-3611-4c10-a9a6-3eb3558c3930 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:57.990426 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 442/879] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:37:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:37:57.995913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69a17b-9284-446c-ab6a-5a991be6452f None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:57.996352 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69a17b-9284-446c-ab6a-5a991be6452f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:57.996456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d69a17b-9284-446c-ab6a-5a991be6452f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:58.017399 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-9d69a17b-9284-446c-ab6a-5a991be6452f None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:37:58.018569 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-9d69a17b-9284-446c-ab6a-5a991be6452f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:37:58.026708 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 438/880] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:37:57 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:37:58.374699 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963d69-3611-4c10-a9a6-3eb3558c3930 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:37:58.390714 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba963d69-3611-4c10-a9a6-3eb3558c3930 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:37:58.395714 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9868e69a-c1d3-4d36-89f8-fac4e2e8b4ce service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:37:58.396685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868e69a-c1d3-4d36-89f8-fac4e2e8b4ce service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:37:58.396685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868e69a-c1d3-4d36-89f8-fac4e2e8b4ce service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:37:58.397163 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9868e69a-c1d3-4d36-89f8-fac4e2e8b4ce service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:37:58.405570 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868e69a-c1d3-4d36-89f8-fac4e2e8b4ce service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:37:58.407182 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9868e69a-c1d3-4d36-89f8-fac4e2e8b4ce service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:37:58.417216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 443/881] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:37:58 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:38:00.980480 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629abb2-044d-4f55-9109-f750178d92c9 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:00.981385 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629abb2-044d-4f55-9109-f750178d92c9 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:00.981385 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1629abb2-044d-4f55-9109-f750178d92c9 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:00.982769 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 439/882] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:38:00.988882 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59aa2-8d00-4366-8f7d-6aef1f4db8dc None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:00.989315 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59aa2-8d00-4366-8f7d-6aef1f4db8dc None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:00.989447 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f59aa2-8d00-4366-8f7d-6aef1f4db8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:01.018203 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-13f59aa2-8d00-4366-8f7d-6aef1f4db8dc None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:38:01.019431 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-13f59aa2-8d00-4366-8f7d-6aef1f4db8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:38:01.028287 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 444/883] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:38:00 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:38:01.367183 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629abb2-044d-4f55-9109-f750178d92c9 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:38:01.382279 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1629abb2-044d-4f55-9109-f750178d92c9 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:38:01.386682 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a721e8-6eae-44cc-8544-59ffbf1a5053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:38:01.387298 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a721e8-6eae-44cc-8544-59ffbf1a5053 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:01.387580 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a721e8-6eae-44cc-8544-59ffbf1a5053 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:01.387848 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a721e8-6eae-44cc-8544-59ffbf1a5053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:01.397323 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a721e8-6eae-44cc-8544-59ffbf1a5053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:38:01.398773 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a721e8-6eae-44cc-8544-59ffbf1a5053 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:38:01.408495 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 440/884] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:38:01 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:38:03.833801 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648736a-4fb0-4be1-9fed-aaf1a1f87b6e None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:03.834369 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648736a-4fb0-4be1-9fed-aaf1a1f87b6e None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:03.834369 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8648736a-4fb0-4be1-9fed-aaf1a1f87b6e None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:03.835696 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 445/885] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:38:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:38:03.842183 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c5a3f-c82e-4ae7-a8a7-f87103c57acc None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:03.842897 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c5a3f-c82e-4ae7-a8a7-f87103c57acc None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:03.843043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7c5a3f-c82e-4ae7-a8a7-f87103c57acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:03.869465 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-ad7c5a3f-c82e-4ae7-a8a7-f87103c57acc None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:38:03.870722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-ad7c5a3f-c82e-4ae7-a8a7-f87103c57acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:38:03.879978 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 441/886] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:38:03 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:38:04.219937 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648736a-4fb0-4be1-9fed-aaf1a1f87b6e None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:38:04.234607 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8648736a-4fb0-4be1-9fed-aaf1a1f87b6e None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:38:04.242103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7b89a-ac9a-461f-ab4d-9e94f5787576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:38:04.243029 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b89a-ac9a-461f-ab4d-9e94f5787576 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:04.243393 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b89a-ac9a-461f-ab4d-9e94f5787576 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:04.243816 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7b89a-ac9a-461f-ab4d-9e94f5787576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:04.255748 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7b89a-ac9a-461f-ab4d-9e94f5787576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:38:04.257186 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7b89a-ac9a-461f-ab4d-9e94f5787576 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:38:04.266743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 446/887] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:38:04 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:38:06.746432 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41205e6c-ee61-4e72-9574-7ce64e2b74d5 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:06.747007 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41205e6c-ee61-4e72-9574-7ce64e2b74d5 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:06.747007 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41205e6c-ee61-4e72-9574-7ce64e2b74d5 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:06.748354 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 442/888] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:38:06.754598 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b431c-e9f4-4cf1-84b2-a8f070188817 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:06.755372 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b431c-e9f4-4cf1-84b2-a8f070188817 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:06.755522 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63b431c-e9f4-4cf1-84b2-a8f070188817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:06.778946 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-a63b431c-e9f4-4cf1-84b2-a8f070188817 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:38:06.780146 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-a63b431c-e9f4-4cf1-84b2-a8f070188817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:38:06.789095 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 447/889] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:38:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:38:07.127092 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41205e6c-ee61-4e72-9574-7ce64e2b74d5 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:38:07.139302 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41205e6c-ee61-4e72-9574-7ce64e2b74d5 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:38:07.143407 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ccc29a-e6f8-4d37-81af-ce94a72951c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:38:07.143995 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc29a-e6f8-4d37-81af-ce94a72951c7 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:07.144275 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc29a-e6f8-4d37-81af-ce94a72951c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:07.144526 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ccc29a-e6f8-4d37-81af-ce94a72951c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:07.153669 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccc29a-e6f8-4d37-81af-ce94a72951c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:38:07.155170 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ccc29a-e6f8-4d37-81af-ce94a72951c7 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:38:07.164486 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 443/890] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:38:07 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:38:09.725569 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e5eb-febe-45d5-a2c3-7d4f107cc792 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:09.726183 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e5eb-febe-45d5-a2c3-7d4f107cc792 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:09.726183 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce85e5eb-febe-45d5-a2c3-7d4f107cc792 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:09.728094 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 448/891] 10.222.0.39 () {54 vars in 927 bytes} [Sat Oct 22 20:38:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:38:09.735879 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5d1c2-3ee3-4ea1-a3b3-0a99655b5e85 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:09.736302 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5d1c2-3ee3-4ea1-a3b3-0a99655b5e85 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:09.736394 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5d1c2-3ee3-4ea1-a3b3-0a99655b5e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:09.756055 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-5ca5d1c2-3ee3-4ea1-a3b3-0a99655b5e85 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:38:09.757240 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-5ca5d1c2-3ee3-4ea1-a3b3-0a99655b5e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:38:09.765980 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 444/892] 10.222.0.39 () {58 vars in 1024 bytes} [Sat Oct 22 20:38:09 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:38:10.105001 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e5eb-febe-45d5-a2c3-7d4f107cc792 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:38:10.124254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce85e5eb-febe-45d5-a2c3-7d4f107cc792 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:38:10.128118 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4d3331-1877-4601-aa13-4cebb7976069 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:38:10.128716 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d3331-1877-4601-aa13-4cebb7976069 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:38:10.128989 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d3331-1877-4601-aa13-4cebb7976069 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:38:10.129254 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4d3331-1877-4601-aa13-4cebb7976069 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:38:10.138266 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d3331-1877-4601-aa13-4cebb7976069 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:38:10.139716 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4d3331-1877-4601-aa13-4cebb7976069 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:38:10.149034 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 449/893] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:38:10 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:38:19.751074 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=33 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:38:20.145218 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=33 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:31.847900 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeff921-e92b-4e8e-9c7c-f1302db22ff4 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:31.848921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeff921-e92b-4e8e-9c7c-f1302db22ff4 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:31.848921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeff921-e92b-4e8e-9c7c-f1302db22ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:31.878247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-eaeff921-e92b-4e8e-9c7c-f1302db22ff4 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:39:31.879495 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-eaeff921-e92b-4e8e-9c7c-f1302db22ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:39:31.888338 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 445/894] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:39:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:39:31.896324 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786f0ed-31d3-4478-bf1e-a1520ded35b1 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:31.896860 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786f0ed-31d3-4478-bf1e-a1520ded35b1 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:31.896860 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786f0ed-31d3-4478-bf1e-a1520ded35b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:31.917581 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-d786f0ed-31d3-4478-bf1e-a1520ded35b1 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:39:31.918789 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-d786f0ed-31d3-4478-bf1e-a1520ded35b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:39:31.928195 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 450/895] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:39:31 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:39:31.932886 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeff921-e92b-4e8e-9c7c-f1302db22ff4 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:31.943198 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeff921-e92b-4e8e-9c7c-f1302db22ff4 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:31.950429 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:31.951016 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:31.951293 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:31.951571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:31.952203 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:39:31.952503 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:31.953512 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING py.warnings [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:39:31.953512 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: warnings.warn(msg) Oct 22 20:39:31.953512 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: Oct 22 20:39:31.954398 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:31.967749 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 446/896] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Oct 22 20:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:39:31.977290 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786f0ed-31d3-4478-bf1e-a1520ded35b1 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:31.987699 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786f0ed-31d3-4478-bf1e-a1520ded35b1 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:31.993957 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788698d-ba06-4072-b98a-396f5517b92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:31.994553 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788698d-ba06-4072-b98a-396f5517b92e admin admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:31.994825 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788698d-ba06-4072-b98a-396f5517b92e admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:31.995091 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0788698d-ba06-4072-b98a-396f5517b92e admin admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:31.995750 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788698d-ba06-4072-b98a-396f5517b92e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:31.996792 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WARNING py.warnings [None req-0788698d-ba06-4072-b98a-396f5517b92e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:39:31.996792 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: warnings.warn(msg) Oct 22 20:39:31.996792 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: Oct 22 20:39:31.998040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0788698d-ba06-4072-b98a-396f5517b92e admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:32.028082 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 451/897] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Oct 22 20:39:31 2022] POST /identity/v3/projects => generated 377 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:39:32.032543 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:32.042983 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15706603-5c2b-40e7-b74b-df69d8122584 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:32.103351 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12df60-2cd7-4619-8e64-9b74e53e3c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:32.103871 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12df60-2cd7-4619-8e64-9b74e53e3c83 admin admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.104184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12df60-2cd7-4619-8e64-9b74e53e3c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.104447 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be12df60-2cd7-4619-8e64-9b74e53e3c83 admin admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.105066 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12df60-2cd7-4619-8e64-9b74e53e3c83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:32.106397 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING py.warnings [None req-be12df60-2cd7-4619-8e64-9b74e53e3c83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:39:32.106397 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: warnings.warn(msg) Oct 22 20:39:32.106397 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: Oct 22 20:39:32.107671 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be12df60-2cd7-4619-8e64-9b74e53e3c83 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:32.130504 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 447/898] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:39:32 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:39:32.134845 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788698d-ba06-4072-b98a-396f5517b92e admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:32.145412 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0788698d-ba06-4072-b98a-396f5517b92e admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:32.150381 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e5777-b49a-493f-85bb-0def729fd338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:32.150978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e5777-b49a-493f-85bb-0def729fd338 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.151253 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e5777-b49a-493f-85bb-0def729fd338 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.151554 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1e5777-b49a-493f-85bb-0def729fd338 admin admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.152188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e5777-b49a-493f-85bb-0def729fd338 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:32.153881 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1e5777-b49a-493f-85bb-0def729fd338 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:32.166678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 452/899] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:39:32.171003 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12df60-2cd7-4619-8e64-9b74e53e3c83 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:32.181595 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be12df60-2cd7-4619-8e64-9b74e53e3c83 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:32.187014 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d185f4d8-48a8-4b7c-bbd3-bb5806163ff2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:32.187644 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f4d8-48a8-4b7c-bbd3-bb5806163ff2 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.187926 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f4d8-48a8-4b7c-bbd3-bb5806163ff2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.188180 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d185f4d8-48a8-4b7c-bbd3-bb5806163ff2 admin admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.188802 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185f4d8-48a8-4b7c-bbd3-bb5806163ff2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:32.190384 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d185f4d8-48a8-4b7c-bbd3-bb5806163ff2 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:32.203846 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 448/900] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:39:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:39:32.209924 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e5777-b49a-493f-85bb-0def729fd338 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:32.225087 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1e5777-b49a-493f-85bb-0def729fd338 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:32.232531 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1920f103-dae1-4491-ad2a-e936a919e562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:32.233178 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f103-dae1-4491-ad2a-e936a919e562 admin admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.233448 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f103-dae1-4491-ad2a-e936a919e562 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.233689 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1920f103-dae1-4491-ad2a-e936a919e562 admin admin] PATH_INFO: `/v3/projects/5b32806a09ef4b3893fc5a3770220392/users/8505833560484045baa295462488cc24/roles/72c390b29d3240dd8c46b0fd1b18441e` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.248428 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920f103-dae1-4491-ad2a-e936a919e562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b32806a09ef4b3893fc5a3770220392, user_id=8505833560484045baa295462488cc24, role_id=72c390b29d3240dd8c46b0fd1b18441e)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:32.251082 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1920f103-dae1-4491-ad2a-e936a919e562 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:32.266020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 453/901] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Oct 22 20:39:32 2022] PUT /identity/v3/projects/5b32806a09ef4b3893fc5a3770220392/users/8505833560484045baa295462488cc24/roles/72c390b29d3240dd8c46b0fd1b18441e => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:39:32.277557 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b76ffa-7999-4c08-b033-e992e0e9b7ec None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.277835 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b76ffa-7999-4c08-b033-e992e0e9b7ec None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.278100 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b76ffa-7999-4c08-b033-e992e0e9b7ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.305421 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-f4b76ffa-7999-4c08-b033-e992e0e9b7ec None None] MFA Rules not processed for user `8505833560484045baa295462488cc24`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:39:32.306610 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-f4b76ffa-7999-4c08-b033-e992e0e9b7ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:39:32.371506 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 449/902] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:39:32 2022] POST /identity/v3/auth/tokens => generated 2814 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:39:32.385119 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cead2-5bb9-4499-bb75-91026d2d8517 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.385411 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cead2-5bb9-4499-bb75-91026d2d8517 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.385676 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390cead2-5bb9-4499-bb75-91026d2d8517 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.387048 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 454/903] 10.222.0.39 () {54 vars in 963 bytes} [Sat Oct 22 20:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:39:32.392243 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da898020-a9b7-4610-a2d9-3c7f90c089c3 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.392581 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da898020-a9b7-4610-a2d9-3c7f90c089c3 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.392851 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da898020-a9b7-4610-a2d9-3c7f90c089c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.414038 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-da898020-a9b7-4610-a2d9-3c7f90c089c3 None None] MFA Rules not processed for user `c0efaeef0d724cc69ce9daa0f70856d8`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:39:32.415231 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-da898020-a9b7-4610-a2d9-3c7f90c089c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:39:32.462958 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:32.471511 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 450/904] 10.222.0.39 () {58 vars in 1060 bytes} [Sat Oct 22 20:39:32 2022] POST /identity/v3/auth/tokens => generated 2680 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:39:32.479105 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cead2-5bb9-4499-bb75-91026d2d8517 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:32.491829 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390cead2-5bb9-4499-bb75-91026d2d8517 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:32.495878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e28fe-1dbf-4dc3-87e4-82627256af1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0efaeef0d724cc69ce9daa0f70856d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:32.496463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e28fe-1dbf-4dc3-87e4-82627256af1c service cinder] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.496733 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e28fe-1dbf-4dc3-87e4-82627256af1c service cinder] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.496998 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286e28fe-1dbf-4dc3-87e4-82627256af1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.506135 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e28fe-1dbf-4dc3-87e4-82627256af1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:32.507574 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286e28fe-1dbf-4dc3-87e4-82627256af1c service cinder] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:32.516587 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 455/905] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:39:32 2022] GET /identity/v3/auth/tokens => generated 2814 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:39:32.557037 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c986fa4-9c8a-47fa-b401-c4467a912611 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.557319 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c986fa4-9c8a-47fa-b401-c4467a912611 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.557589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c986fa4-9c8a-47fa-b401-c4467a912611 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.558857 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 451/906] 10.222.0.39 () {52 vars in 830 bytes} [Sat Oct 22 20:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:39:32.562763 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e28fe-1dbf-4dc3-87e4-82627256af1c service cinder] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:32.626445 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286e28fe-1dbf-4dc3-87e4-82627256af1c service cinder] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:32.631366 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:32.631971 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.632242 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.632529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] PATH_INFO: `/v3/users/8505833560484045baa295462488cc24` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.633658 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8505833560484045baa295462488cc24)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:32.634658 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WARNING py.warnings [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:39:32.634658 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: warnings.warn(msg) Oct 22 20:39:32.634658 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: Oct 22 20:39:32.635883 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:32.704829 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8505833560484045baa295462488cc24'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:32.718911 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8505833560484045baa295462488cc24'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:32.719719 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8505833560484045baa295462488cc24'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:32.745167 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8505833560484045baa295462488cc24'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:32.756641 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8505833560484045baa295462488cc24'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:32.762781 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 456/907] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Oct 22 20:39:32 2022] DELETE /identity/v3/users/8505833560484045baa295462488cc24 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:39:32.767228 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da024-53c1-47e7-a586-d23950c064b1 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.767545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da024-53c1-47e7-a586-d23950c064b1 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.767839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791da024-53c1-47e7-a586-d23950c064b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.791669 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-791da024-53c1-47e7-a586-d23950c064b1 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:39:32.792843 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-791da024-53c1-47e7-a586-d23950c064b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:39:32.852909 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 452/908] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:39:32 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:39:32.866747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:32.869265 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:39:32.876413 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:32.940593 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a52f194-eef5-44c8-b6f7-67a5b21230a4 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:32.945733 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b12c97a-7d77-48af-a593-fd477f1f7d25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:32.946345 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12c97a-7d77-48af-a593-fd477f1f7d25 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:32.946617 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12c97a-7d77-48af-a593-fd477f1f7d25 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:32.946881 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b12c97a-7d77-48af-a593-fd477f1f7d25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:32.957988 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12c97a-7d77-48af-a593-fd477f1f7d25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:32.959453 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b12c97a-7d77-48af-a593-fd477f1f7d25 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:32.968978 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 457/909] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:39:32 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:39:33.310454 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da024-53c1-47e7-a586-d23950c064b1 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:39:33.312040 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-791da024-53c1-47e7-a586-d23950c064b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:39:33.324664 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791da024-53c1-47e7-a586-d23950c064b1 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:39:33.329512 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:39:33.330142 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:39:33.330483 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:39:33.330682 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] PATH_INFO: `/v3/projects/5b32806a09ef4b3893fc5a3770220392` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:39:33.331903 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b32806a09ef4b3893fc5a3770220392)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:39:33.332930 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING py.warnings [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:39:33.332930 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: warnings.warn(msg) Oct 22 20:39:33.332930 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: Oct 22 20:39:33.334123 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:39:33.396031 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b32806a09ef4b3893fc5a3770220392', 'request_id': 'req-5b3976bc-daa0-4b03-aad6-a7924fb53d91'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:33.405491 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b32806a09ef4b3893fc5a3770220392', 'request_id': 'req-5b3976bc-daa0-4b03-aad6-a7924fb53d91'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:33.411905 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b32806a09ef4b3893fc5a3770220392', 'request_id': 'req-5b3976bc-daa0-4b03-aad6-a7924fb53d91'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:33.429980 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] The token cache is being invalidate because project 5b32806a09ef4b3893fc5a3770220392 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 22 20:39:33.430261 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:33.430939 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-5b3976bc-daa0-4b03-aad6-a7924fb53d91 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:39:33.432589 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 453/910] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Oct 22 20:39:33 2022] DELETE /identity/v3/projects/5b32806a09ef4b3893fc5a3770220392 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:39:42.964967 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=25 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:39:43.426832 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:40:50.437239 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141f4c2-43cd-4d32-8887-5796c5da4b92 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:50.437774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141f4c2-43cd-4d32-8887-5796c5da4b92 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:50.437774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b141f4c2-43cd-4d32-8887-5796c5da4b92 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:50.439094 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 458/911] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:40:50.444052 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02e364-68ea-4356-a55e-59231c9d8eca None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:50.444495 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02e364-68ea-4356-a55e-59231c9d8eca None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:50.444591 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e02e364-68ea-4356-a55e-59231c9d8eca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:50.523675 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-5e02e364-68ea-4356-a55e-59231c9d8eca None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:40:50.524871 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-5e02e364-68ea-4356-a55e-59231c9d8eca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:40:50.622593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 454/912] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:40:50 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:40:50.785216 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141f4c2-43cd-4d32-8887-5796c5da4b92 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:40:50.787318 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-b141f4c2-43cd-4d32-8887-5796c5da4b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:40:50.882364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b141f4c2-43cd-4d32-8887-5796c5da4b92 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:40:50.887688 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e4fc50-d810-41da-999f-dec42d6f2bf6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:40:50.888282 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4fc50-d810-41da-999f-dec42d6f2bf6 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:50.888554 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4fc50-d810-41da-999f-dec42d6f2bf6 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:50.888816 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e4fc50-d810-41da-999f-dec42d6f2bf6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:50.897320 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4fc50-d810-41da-999f-dec42d6f2bf6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:40:50.898888 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e4fc50-d810-41da-999f-dec42d6f2bf6 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:40:50.908673 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 459/913] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:40:50 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:40:52.513551 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870231ef-7d4a-413d-baa5-538868215145 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:52.514388 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870231ef-7d4a-413d-baa5-538868215145 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:52.514388 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870231ef-7d4a-413d-baa5-538868215145 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:52.516647 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 455/914] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:40:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:40:52.522330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0ee3-5e80-437b-beb9-3a6dbacc9bd3 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:52.522775 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0ee3-5e80-437b-beb9-3a6dbacc9bd3 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:52.522874 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596b0ee3-5e80-437b-beb9-3a6dbacc9bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:52.543551 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-596b0ee3-5e80-437b-beb9-3a6dbacc9bd3 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:40:52.544730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-596b0ee3-5e80-437b-beb9-3a6dbacc9bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:40:52.553742 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 460/915] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:40:52 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:40:52.714692 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870231ef-7d4a-413d-baa5-538868215145 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:40:52.729897 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870231ef-7d4a-413d-baa5-538868215145 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:40:52.736182 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923973d7-7be2-4a52-82f2-c2f371cb1fbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:40:52.736787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923973d7-7be2-4a52-82f2-c2f371cb1fbd service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:52.737059 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923973d7-7be2-4a52-82f2-c2f371cb1fbd service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:52.737319 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923973d7-7be2-4a52-82f2-c2f371cb1fbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:52.745774 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923973d7-7be2-4a52-82f2-c2f371cb1fbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:40:52.747414 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923973d7-7be2-4a52-82f2-c2f371cb1fbd service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:40:52.756913 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 456/916] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:40:52 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:40:55.772040 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685758a0-7d7d-4ead-9975-a965f0866f60 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:55.772659 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685758a0-7d7d-4ead-9975-a965f0866f60 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:55.772659 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685758a0-7d7d-4ead-9975-a965f0866f60 None None] PATH_INFO: `/v3` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:55.773841 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 461/917] 10.222.0.26 () {54 vars in 925 bytes} [Sat Oct 22 20:40:55 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Oct 22 20:40:55.780593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd6a20-9462-413f-93c6-c59a2af6e0b1 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:55.781067 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd6a20-9462-413f-93c6-c59a2af6e0b1 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:55.781167 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bd6a20-9462-413f-93c6-c59a2af6e0b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:55.812565 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-04bd6a20-9462-413f-93c6-c59a2af6e0b1 None None] MFA Rules not processed for user `9b73c8f104d7476294921098cec0a8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:40:55.813759 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-04bd6a20-9462-413f-93c6-c59a2af6e0b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:40:55.873537 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:40:55.883730 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 457/918] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Oct 22 20:40:55 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:40:59.580285 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f34bb-ce27-47e3-b5e1-58273be1d54f None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:59.580769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f34bb-ce27-47e3-b5e1-58273be1d54f None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:59.580866 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60f34bb-ce27-47e3-b5e1-58273be1d54f None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:59.582818 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 462/919] 10.222.0.39 () {54 vars in 961 bytes} [Sat Oct 22 20:40:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:40:59.590931 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c465a-544c-44cf-910d-1a484200d335 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:59.591439 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c465a-544c-44cf-910d-1a484200d335 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:59.591551 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42c465a-544c-44cf-910d-1a484200d335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:59.612846 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-b42c465a-544c-44cf-910d-1a484200d335 None None] MFA Rules not processed for user `9b73c8f104d7476294921098cec0a8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:40:59.614041 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-b42c465a-544c-44cf-910d-1a484200d335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:40:59.623712 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 458/920] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Oct 22 20:40:59 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:40:59.631163 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f34bb-ce27-47e3-b5e1-58273be1d54f None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:40:59.646330 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60f34bb-ce27-47e3-b5e1-58273be1d54f None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:40:59.652571 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d6fbb8-733e-4633-b9e8-fd33be55bd7a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b73c8f104d7476294921098cec0a8bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:40:59.653377 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6fbb8-733e-4633-b9e8-fd33be55bd7a service placement] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:40:59.653726 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6fbb8-733e-4633-b9e8-fd33be55bd7a service placement] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:40:59.654005 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d6fbb8-733e-4633-b9e8-fd33be55bd7a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:40:59.664067 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6fbb8-733e-4633-b9e8-fd33be55bd7a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:40:59.665752 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d6fbb8-733e-4633-b9e8-fd33be55bd7a service placement] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:40:59.675745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 463/921] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:40:59 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:41:04.790156 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a7e5-7bc8-493a-983e-af0f7d1bfaef None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:04.790749 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a7e5-7bc8-493a-983e-af0f7d1bfaef None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:04.790749 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188a7e5-7bc8-493a-983e-af0f7d1bfaef None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:04.792074 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 459/922] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:41:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:41:04.797879 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df412-5f71-4fc2-b75c-8d718895e683 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:04.798597 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df412-5f71-4fc2-b75c-8d718895e683 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:04.798747 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8df412-5f71-4fc2-b75c-8d718895e683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:04.824363 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-5c8df412-5f71-4fc2-b75c-8d718895e683 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:41:04.825536 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-5c8df412-5f71-4fc2-b75c-8d718895e683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:04.833770 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 464/923] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:41:04 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:41:05.011401 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188a7e5-7bc8-493a-983e-af0f7d1bfaef None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:41:05.027827 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188a7e5-7bc8-493a-983e-af0f7d1bfaef None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:41:05.033367 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce1795c-28d5-44c5-93a1-f63dc60fe3b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:41:05.033954 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1795c-28d5-44c5-93a1-f63dc60fe3b3 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:05.034225 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1795c-28d5-44c5-93a1-f63dc60fe3b3 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:05.034484 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce1795c-28d5-44c5-93a1-f63dc60fe3b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:05.042824 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1795c-28d5-44c5-93a1-f63dc60fe3b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:41:05.044368 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce1795c-28d5-44c5-93a1-f63dc60fe3b3 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:41:05.054370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 460/924] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:41:05 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 22 20:41:06.670395 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4379515-eeef-4490-b526-4f4bb9fa91f6 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:06.671204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4379515-eeef-4490-b526-4f4bb9fa91f6 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:06.671204 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4379515-eeef-4490-b526-4f4bb9fa91f6 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:06.673387 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 465/925] 127.0.0.1 () {54 vars in 901 bytes} [Sat Oct 22 20:41:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:41:06.678986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c9bda-846c-40ad-b31b-95b5eb03f642 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:06.679708 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c9bda-846c-40ad-b31b-95b5eb03f642 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:06.679839 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c9bda-846c-40ad-b31b-95b5eb03f642 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:06.703110 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-1f9c9bda-846c-40ad-b31b-95b5eb03f642 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:41:06.704328 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-1f9c9bda-846c-40ad-b31b-95b5eb03f642 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:06.712956 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 461/926] 127.0.0.1 () {58 vars in 998 bytes} [Sat Oct 22 20:41:06 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:41:06.872319 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4379515-eeef-4490-b526-4f4bb9fa91f6 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:41:06.889730 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4379515-eeef-4490-b526-4f4bb9fa91f6 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:41:06.895215 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a416275c-4ef9-43c1-a842-b29ae14a025e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:41:06.895842 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416275c-4ef9-43c1-a842-b29ae14a025e service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:06.896121 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416275c-4ef9-43c1-a842-b29ae14a025e service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:06.896395 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a416275c-4ef9-43c1-a842-b29ae14a025e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:06.904748 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416275c-4ef9-43c1-a842-b29ae14a025e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:41:06.906327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a416275c-4ef9-43c1-a842-b29ae14a025e service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:41:06.915754 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 466/927] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:41:06 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:41:11.136754 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe0b7e-3c6b-422a-bee2-522a6cbffab8 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:11.137319 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe0b7e-3c6b-422a-bee2-522a6cbffab8 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:11.137319 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfe0b7e-3c6b-422a-bee2-522a6cbffab8 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:11.138609 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 462/928] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:41:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:41:11.144989 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af3934-693a-479a-b253-aa648a8b11a0 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:11.145686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af3934-693a-479a-b253-aa648a8b11a0 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:11.145779 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11af3934-693a-479a-b253-aa648a8b11a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:11.176478 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-11af3934-693a-479a-b253-aa648a8b11a0 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:41:11.177653 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-11af3934-693a-479a-b253-aa648a8b11a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:11.186368 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 467/929] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:41:11 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:41:11.527405 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe0b7e-3c6b-422a-bee2-522a6cbffab8 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:41:11.530587 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-9cfe0b7e-3c6b-422a-bee2-522a6cbffab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:11.590165 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfe0b7e-3c6b-422a-bee2-522a6cbffab8 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:41:11.594000 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57ca3b4-27c8-4174-a94d-e9e05a477cb5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:41:11.594585 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ca3b4-27c8-4174-a94d-e9e05a477cb5 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:11.594858 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ca3b4-27c8-4174-a94d-e9e05a477cb5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:11.595118 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57ca3b4-27c8-4174-a94d-e9e05a477cb5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:11.604285 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ca3b4-27c8-4174-a94d-e9e05a477cb5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:41:11.605706 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57ca3b4-27c8-4174-a94d-e9e05a477cb5 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:41:11.615299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 463/930] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:41:11 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:41:13.968493 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6662-3fe5-487e-a0f9-26df269b471b None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:13.969081 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6662-3fe5-487e-a0f9-26df269b471b None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:13.969081 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e6662-3fe5-487e-a0f9-26df269b471b None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:13.971098 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 468/931] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:41:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:41:13.977497 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488b9cf-f39a-46a0-82c7-52465e0d00ab None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:13.977921 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488b9cf-f39a-46a0-82c7-52465e0d00ab None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:13.978056 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5488b9cf-f39a-46a0-82c7-52465e0d00ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:14.002063 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-5488b9cf-f39a-46a0-82c7-52465e0d00ab None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:41:14.003251 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-5488b9cf-f39a-46a0-82c7-52465e0d00ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:14.011544 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 464/932] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:41:13 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:41:14.349731 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e6662-3fe5-487e-a0f9-26df269b471b None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:41:14.351932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-cc9e6662-3fe5-487e-a0f9-26df269b471b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:14.364247 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=61 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:41:14.372917 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e6662-3fe5-487e-a0f9-26df269b471b None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:41:14.377338 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665a606f-72c9-48ec-9c2e-8526ff85175f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:41:14.377935 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a606f-72c9-48ec-9c2e-8526ff85175f service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:14.378208 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a606f-72c9-48ec-9c2e-8526ff85175f service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:14.378471 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665a606f-72c9-48ec-9c2e-8526ff85175f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:14.388942 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a606f-72c9-48ec-9c2e-8526ff85175f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:41:14.390369 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665a606f-72c9-48ec-9c2e-8526ff85175f service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:41:14.400578 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 469/933] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:41:14 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:41:18.203004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c212f-6d91-43a4-8c55-07d0380fb0c6 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:18.203965 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c212f-6d91-43a4-8c55-07d0380fb0c6 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:18.203965 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27c212f-6d91-43a4-8c55-07d0380fb0c6 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:18.206369 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 465/934] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:41:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:41:18.212356 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6943105-2499-4408-bed9-8b21e786a9dc None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:18.213046 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6943105-2499-4408-bed9-8b21e786a9dc None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:18.213194 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6943105-2499-4408-bed9-8b21e786a9dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:18.236273 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-c6943105-2499-4408-bed9-8b21e786a9dc None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:41:18.237490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-c6943105-2499-4408-bed9-8b21e786a9dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:18.245472 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 470/935] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:41:18 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:41:18.599076 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c212f-6d91-43a4-8c55-07d0380fb0c6 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:41:18.602255 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-b27c212f-6d91-43a4-8c55-07d0380fb0c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:18.666930 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27c212f-6d91-43a4-8c55-07d0380fb0c6 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:41:18.670776 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11b7af-5fa1-45eb-9676-f43386d9357e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0efaeef0d724cc69ce9daa0f70856d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:41:18.671390 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b7af-5fa1-45eb-9676-f43386d9357e service cinder] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:18.671662 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b7af-5fa1-45eb-9676-f43386d9357e service cinder] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:18.671925 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11b7af-5fa1-45eb-9676-f43386d9357e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:18.681134 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11b7af-5fa1-45eb-9676-f43386d9357e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:41:18.682549 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11b7af-5fa1-45eb-9676-f43386d9357e service cinder] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:41:18.691907 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 466/936] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:41:18 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:41:21.049617 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48809c-4525-4b74-a896-0f36d792fd8c None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:21.050483 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48809c-4525-4b74-a896-0f36d792fd8c None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:21.050483 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48809c-4525-4b74-a896-0f36d792fd8c None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:21.053258 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 471/937] 127.0.0.1 () {54 vars in 917 bytes} [Sat Oct 22 20:41:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:41:21.061459 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad85d5f-e044-422c-8f31-a22d7973ff36 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:21.061909 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad85d5f-e044-422c-8f31-a22d7973ff36 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:21.062023 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad85d5f-e044-422c-8f31-a22d7973ff36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:21.083666 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-2ad85d5f-e044-422c-8f31-a22d7973ff36 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:41:21.084850 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-2ad85d5f-e044-422c-8f31-a22d7973ff36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:21.093116 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 467/938] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Oct 22 20:41:21 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:41:21.443192 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48809c-4525-4b74-a896-0f36d792fd8c None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:41:21.445268 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-2e48809c-4525-4b74-a896-0f36d792fd8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:41:21.459076 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48809c-4525-4b74-a896-0f36d792fd8c None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:41:21.462886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a0413d6-3894-4bba-9516-8e90c289d04d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c0efaeef0d724cc69ce9daa0f70856d8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:41:21.463506 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0413d6-3894-4bba-9516-8e90c289d04d service cinder] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:41:21.463774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0413d6-3894-4bba-9516-8e90c289d04d service cinder] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:41:21.464038 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a0413d6-3894-4bba-9516-8e90c289d04d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:41:21.473289 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0413d6-3894-4bba-9516-8e90c289d04d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:41:21.474707 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a0413d6-3894-4bba-9516-8e90c289d04d service cinder] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:41:21.484293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 472/939] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:41:21 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:41:31.078396 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=70 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:41:31.480198 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=14 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:33.180688 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f253c-8521-4c2a-822a-f58f62b961e6 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.181327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f467fe2-2e7b-4b1b-a441-d098c6151936 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.181728 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f253c-8521-4c2a-822a-f58f62b961e6 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.181824 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f467fe2-2e7b-4b1b-a441-d098c6151936 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.181915 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f253c-8521-4c2a-822a-f58f62b961e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.182001 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f467fe2-2e7b-4b1b-a441-d098c6151936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.201162 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-4f467fe2-2e7b-4b1b-a441-d098c6151936 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:33.201389 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-380f253c-8521-4c2a-822a-f58f62b961e6 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:33.209878 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-380f253c-8521-4c2a-822a-f58f62b961e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:33.210050 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-4f467fe2-2e7b-4b1b-a441-d098c6151936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:33.217985 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 473/940] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:42:33.219175 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 468/941] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:33.227184 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82a278-61d9-46c3-aba1-5223d09813a4 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.227491 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82a278-61d9-46c3-aba1-5223d09813a4 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.227757 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db82a278-61d9-46c3-aba1-5223d09813a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.228091 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b023c-574d-4011-a447-bb5b80a3b2ba None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.228371 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b023c-574d-4011-a447-bb5b80a3b2ba None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.228772 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285b023c-574d-4011-a447-bb5b80a3b2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.247345 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-db82a278-61d9-46c3-aba1-5223d09813a4 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:33.248529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-db82a278-61d9-46c3-aba1-5223d09813a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:33.248657 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-285b023c-574d-4011-a447-bb5b80a3b2ba None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:33.249857 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-285b023c-574d-4011-a447-bb5b80a3b2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:33.256505 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 474/942] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:33.258287 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 469/943] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:33.260991 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82a278-61d9-46c3-aba1-5223d09813a4 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.262514 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b023c-574d-4011-a447-bb5b80a3b2ba None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.270447 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db82a278-61d9-46c3-aba1-5223d09813a4 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.271466 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285b023c-574d-4011-a447-bb5b80a3b2ba None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.275034 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.275651 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.275923 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.276025 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffcc89-426f-4c66-b2d3-8ec9c09d836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.276186 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] PATH_INFO: `/v3/domains` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.276559 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffcc89-426f-4c66-b2d3-8ec9c09d836e admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.276817 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88407) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:42:33.276918 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffcc89-426f-4c66-b2d3-8ec9c09d836e admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.277085 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cffcc89-426f-4c66-b2d3-8ec9c09d836e admin admin] PATH_INFO: `/v3/domains` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.277193 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.277710 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffcc89-426f-4c66-b2d3-8ec9c09d836e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=88408) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Oct 22 20:42:33.278004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffcc89-426f-4c66-b2d3-8ec9c09d836e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.278118 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WARNING py.warnings [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:42:33.278118 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: warnings.warn(msg) Oct 22 20:42:33.278118 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: Oct 22 20:42:33.278953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.279612 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cffcc89-426f-4c66-b2d3-8ec9c09d836e admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.290572 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 475/944] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Oct 22 20:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:42:33.291195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 470/945] 10.222.0.39 () {58 vars in 1153 bytes} [Sat Oct 22 20:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Oct 22 20:42:33.298362 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.298951 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffcc89-426f-4c66-b2d3-8ec9c09d836e admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.308361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5ed0bc-4746-469b-afe8-89041b49f4ea admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.308625 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cffcc89-426f-4c66-b2d3-8ec9c09d836e admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.313105 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87731d9a-74b1-4ec7-9710-e930be607caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.313252 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915494-df38-408e-931e-404fa9458cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.313682 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731d9a-74b1-4ec7-9710-e930be607caf admin admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.313792 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915494-df38-408e-931e-404fa9458cad admin admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.313953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731d9a-74b1-4ec7-9710-e930be607caf admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.314048 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915494-df38-408e-931e-404fa9458cad admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.314221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87731d9a-74b1-4ec7-9710-e930be607caf admin admin] PATH_INFO: `/v3/projects` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.314422 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c915494-df38-408e-931e-404fa9458cad admin admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.314876 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87731d9a-74b1-4ec7-9710-e930be607caf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.314978 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c915494-df38-408e-931e-404fa9458cad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.315925 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING py.warnings [None req-5c915494-df38-408e-931e-404fa9458cad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:42:33.315925 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: warnings.warn(msg) Oct 22 20:42:33.315925 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: Oct 22 20:42:33.316791 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87731d9a-74b1-4ec7-9710-e930be607caf admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.317128 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c915494-df38-408e-931e-404fa9458cad admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.356875 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 476/946] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:42:33.361049 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 471/947] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 20:42:33.361225 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87731d9a-74b1-4ec7-9710-e930be607caf admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.362051 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915494-df38-408e-931e-404fa9458cad admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.423813 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87731d9a-74b1-4ec7-9710-e930be607caf admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.426490 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c915494-df38-408e-931e-404fa9458cad admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.428402 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e481be-7210-4fed-9543-1d51c2554a83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.429002 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e481be-7210-4fed-9543-1d51c2554a83 admin admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.429277 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e481be-7210-4fed-9543-1d51c2554a83 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.429544 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e481be-7210-4fed-9543-1d51c2554a83 admin admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.430171 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e481be-7210-4fed-9543-1d51c2554a83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.431221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WARNING py.warnings [None req-e9e481be-7210-4fed-9543-1d51c2554a83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:42:33.431221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: warnings.warn(msg) Oct 22 20:42:33.431221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: Oct 22 20:42:33.431525 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ed62a-04eb-49a3-aa54-a6d14f1ba81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.431879 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ed62a-04eb-49a3-aa54-a6d14f1ba81a admin admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.432151 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ed62a-04eb-49a3-aa54-a6d14f1ba81a admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.432399 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e481be-7210-4fed-9543-1d51c2554a83 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.432513 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ed62a-04eb-49a3-aa54-a6d14f1ba81a admin admin] PATH_INFO: `/v3/users` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.433034 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ed62a-04eb-49a3-aa54-a6d14f1ba81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.434946 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2ed62a-04eb-49a3-aa54-a6d14f1ba81a admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.455165 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 477/948] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/users => generated 290 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Oct 22 20:42:33.461316 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 472/949] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:42:33.461452 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e481be-7210-4fed-9543-1d51c2554a83 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.462343 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ed62a-04eb-49a3-aa54-a6d14f1ba81a admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.468678 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e481be-7210-4fed-9543-1d51c2554a83 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.471895 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ed62a-04eb-49a3-aa54-a6d14f1ba81a admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.473541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816bdd0-4fac-433a-8b8d-14994712b0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.474154 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816bdd0-4fac-433a-8b8d-14994712b0ad admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.474396 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816bdd0-4fac-433a-8b8d-14994712b0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.474665 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e816bdd0-4fac-433a-8b8d-14994712b0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.475279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816bdd0-4fac-433a-8b8d-14994712b0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.476631 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb134a-30f7-407e-ab4a-5cf2b334a8fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.476911 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e816bdd0-4fac-433a-8b8d-14994712b0ad admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.477200 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb134a-30f7-407e-ab4a-5cf2b334a8fb admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.477473 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb134a-30f7-407e-ab4a-5cf2b334a8fb admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.477738 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb134a-30f7-407e-ab4a-5cf2b334a8fb admin admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.478352 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb134a-30f7-407e-ab4a-5cf2b334a8fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.480042 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fb134a-30f7-407e-ab4a-5cf2b334a8fb admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.487098 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 478/950] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 20:42:33.490917 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816bdd0-4fac-433a-8b8d-14994712b0ad admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.491307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 473/951] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 20:42:33.494898 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb134a-30f7-407e-ab4a-5cf2b334a8fb admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.503182 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e816bdd0-4fac-433a-8b8d-14994712b0ad admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.504701 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb134a-30f7-407e-ab4a-5cf2b334a8fb admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.508099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26e92-799a-42e9-afc9-8cd5dfcf65e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.508661 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26e92-799a-42e9-afc9-8cd5dfcf65e7 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.508953 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26e92-799a-42e9-afc9-8cd5dfcf65e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.509200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb26e92-799a-42e9-afc9-8cd5dfcf65e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.509476 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044b337-ba45-4d59-976f-d678dc957e18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.509824 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb26e92-799a-42e9-afc9-8cd5dfcf65e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.510044 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044b337-ba45-4d59-976f-d678dc957e18 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.510316 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044b337-ba45-4d59-976f-d678dc957e18 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.510585 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044b337-ba45-4d59-976f-d678dc957e18 admin admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.511226 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044b337-ba45-4d59-976f-d678dc957e18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.511446 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb26e92-799a-42e9-afc9-8cd5dfcf65e7 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.512821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5044b337-ba45-4d59-976f-d678dc957e18 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.527314 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 474/953] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 20:42:33.527608 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 479/953] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:42:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 20:42:33.528723 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044b337-ba45-4d59-976f-d678dc957e18 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.528853 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26e92-799a-42e9-afc9-8cd5dfcf65e7 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.538472 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb26e92-799a-42e9-afc9-8cd5dfcf65e7 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.538639 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044b337-ba45-4d59-976f-d678dc957e18 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.543006 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0afd38da-7cc2-4e88-89e7-9861ca6b34f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.543147 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ba216-c66d-4c54-8602-763f58c4a026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.543672 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd38da-7cc2-4e88-89e7-9861ca6b34f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.543798 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ba216-c66d-4c54-8602-763f58c4a026 admin admin] REQUEST_METHOD: `PUT` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.543915 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd38da-7cc2-4e88-89e7-9861ca6b34f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.544007 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ba216-c66d-4c54-8602-763f58c4a026 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.544188 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0afd38da-7cc2-4e88-89e7-9861ca6b34f8 admin admin] PATH_INFO: `/v3/projects/79da719c506540389257afa26e3b31ad/users/7190888d97de4cc685ac073e41601ce4/roles/72c390b29d3240dd8c46b0fd1b18441e` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.544299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ba216-c66d-4c54-8602-763f58c4a026 admin admin] PATH_INFO: `/v3/projects/b181771f533c43cc81a30e41c9976ce3/users/055c7a51e3f4415e8cf4ccc3cd446df2/roles/72c390b29d3240dd8c46b0fd1b18441e` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.558463 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd38da-7cc2-4e88-89e7-9861ca6b34f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79da719c506540389257afa26e3b31ad, user_id=7190888d97de4cc685ac073e41601ce4, role_id=72c390b29d3240dd8c46b0fd1b18441e)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.558658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ba216-c66d-4c54-8602-763f58c4a026 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b181771f533c43cc81a30e41c9976ce3, user_id=055c7a51e3f4415e8cf4ccc3cd446df2, role_id=72c390b29d3240dd8c46b0fd1b18441e)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.561157 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0afd38da-7cc2-4e88-89e7-9861ca6b34f8 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.561292 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ba216-c66d-4c54-8602-763f58c4a026 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.575016 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 480/954] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Oct 22 20:42:33 2022] PUT /identity/v3/projects/79da719c506540389257afa26e3b31ad/users/7190888d97de4cc685ac073e41601ce4/roles/72c390b29d3240dd8c46b0fd1b18441e => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:42:33.579014 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 475/955] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Oct 22 20:42:33 2022] PUT /identity/v3/projects/b181771f533c43cc81a30e41c9976ce3/users/055c7a51e3f4415e8cf4ccc3cd446df2/roles/72c390b29d3240dd8c46b0fd1b18441e => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:42:33.582556 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57da92-f2c2-443b-b44c-c7dad7520378 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.582556 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57da92-f2c2-443b-b44c-c7dad7520378 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.582556 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c57da92-f2c2-443b-b44c-c7dad7520378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.583846 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feae4a-d552-426c-9c5a-273324814c56 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.584130 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feae4a-d552-426c-9c5a-273324814c56 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.584398 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2feae4a-d552-426c-9c5a-273324814c56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.598348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-8c57da92-f2c2-443b-b44c-c7dad7520378 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:33.599561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-8c57da92-f2c2-443b-b44c-c7dad7520378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:33.602597 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-d2feae4a-d552-426c-9c5a-273324814c56 None None] MFA Rules not processed for user `f2fce337ce4a417ea9044d0fbc87d49f`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:33.603775 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-d2feae4a-d552-426c-9c5a-273324814c56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:33.640843 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:33.646270 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:33.660238 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 481/956] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:42:33.666895 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 476/957] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:33 2022] POST /identity/v3/auth/tokens => generated 2799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:42:33.673070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57da92-f2c2-443b-b44c-c7dad7520378 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.676689 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feae4a-d552-426c-9c5a-273324814c56 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:33.725929 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c57da92-f2c2-443b-b44c-c7dad7520378 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.729400 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fff82f6-0c68-4fab-a8e3-b04aecbe264e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.729996 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff82f6-0c68-4fab-a8e3-b04aecbe264e service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.730267 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff82f6-0c68-4fab-a8e3-b04aecbe264e service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.730844 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fff82f6-0c68-4fab-a8e3-b04aecbe264e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.733669 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2feae4a-d552-426c-9c5a-273324814c56 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:33.737511 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269504-db50-48dd-bc7e-ae9a4a9ec742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:33.738220 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269504-db50-48dd-bc7e-ae9a4a9ec742 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:33.738495 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269504-db50-48dd-bc7e-ae9a4a9ec742 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:33.738800 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9269504-db50-48dd-bc7e-ae9a4a9ec742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:33.741009 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff82f6-0c68-4fab-a8e3-b04aecbe264e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.742430 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fff82f6-0c68-4fab-a8e3-b04aecbe264e service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.748184 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9269504-db50-48dd-bc7e-ae9a4a9ec742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:33.749669 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9269504-db50-48dd-bc7e-ae9a4a9ec742 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:33.751590 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 482/958] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:42:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:42:33.759418 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 477/959] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:42:33 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Oct 22 20:42:39.193935 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fb0a2-b945-4b07-9df2-7894698cdcd9 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:39.194455 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fb0a2-b945-4b07-9df2-7894698cdcd9 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:39.194455 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946fb0a2-b945-4b07-9df2-7894698cdcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:39.227507 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-946fb0a2-b945-4b07-9df2-7894698cdcd9 None None] MFA Rules not processed for user `7190888d97de4cc685ac073e41601ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:39.228741 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-946fb0a2-b945-4b07-9df2-7894698cdcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:39.316132 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 483/960] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:39 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:42:39.321063 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269504-db50-48dd-bc7e-ae9a4a9ec742 service neutron] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:39.332221 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9269504-db50-48dd-bc7e-ae9a4a9ec742 service neutron] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:39.338538 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529545b-b81b-46b7-b523-f7508295b9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:39.339242 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529545b-b81b-46b7-b523-f7508295b9ea admin admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:39.339646 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529545b-b81b-46b7-b523-f7508295b9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:39.340118 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e529545b-b81b-46b7-b523-f7508295b9ea admin admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:39.340863 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529545b-b81b-46b7-b523-f7508295b9ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:39.343411 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e529545b-b81b-46b7-b523-f7508295b9ea admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:39.393527 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 478/961] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Oct 22 20:42:39 2022] POST /identity/v3/projects => generated 377 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:42:39.395279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fb0a2-b945-4b07-9df2-7894698cdcd9 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:39.421334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946fb0a2-b945-4b07-9df2-7894698cdcd9 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:39.515155 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7e142-0032-400c-891a-a79ab9b828c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:39.515578 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7e142-0032-400c-891a-a79ab9b828c9 admin admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:39.515855 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7e142-0032-400c-891a-a79ab9b828c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:39.516125 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e7e142-0032-400c-891a-a79ab9b828c9 admin admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:39.516833 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7e142-0032-400c-891a-a79ab9b828c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:39.521357 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e7e142-0032-400c-891a-a79ab9b828c9 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:39.569607 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 484/962] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:42:39 2022] POST /identity/v3/users => generated 295 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:42:39.575379 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529545b-b81b-46b7-b523-f7508295b9ea admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:39.590655 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e529545b-b81b-46b7-b523-f7508295b9ea admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:39.602214 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbc638-e1c0-4d3a-8ed2-6ece9677bc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:39.605060 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbc638-e1c0-4d3a-8ed2-6ece9677bc71 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:39.605060 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbc638-e1c0-4d3a-8ed2-6ece9677bc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:39.605060 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbc638-e1c0-4d3a-8ed2-6ece9677bc71 admin admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:39.605328 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbc638-e1c0-4d3a-8ed2-6ece9677bc71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:39.607443 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbc638-e1c0-4d3a-8ed2-6ece9677bc71 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:39.619119 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 479/963] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Oct 22 20:42:39.623025 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7e142-0032-400c-891a-a79ab9b828c9 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:39.635964 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e7e142-0032-400c-891a-a79ab9b828c9 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:39.641347 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c91e36-02f1-4e64-b763-48a2d11ef2fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:39.642294 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c91e36-02f1-4e64-b763-48a2d11ef2fe admin admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:39.642833 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c91e36-02f1-4e64-b763-48a2d11ef2fe admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:39.642942 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c91e36-02f1-4e64-b763-48a2d11ef2fe admin admin] PATH_INFO: `/v3/projects/c6bc3798385a4b85a0a35d9dad669937/users/d77c07596e8b4a0ca52441af7cf96210/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:39.646637 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:39.662339 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c91e36-02f1-4e64-b763-48a2d11ef2fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bc3798385a4b85a0a35d9dad669937, user_id=d77c07596e8b4a0ca52441af7cf96210, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:39.665522 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c91e36-02f1-4e64-b763-48a2d11ef2fe admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:39.680205 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320efaf-091c-4f23-8866-7ede23052809 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:39.680851 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320efaf-091c-4f23-8866-7ede23052809 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:39.681035 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4320efaf-091c-4f23-8866-7ede23052809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:39.699720 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 485/964] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Oct 22 20:42:39 2022] PUT /identity/v3/projects/c6bc3798385a4b85a0a35d9dad669937/users/d77c07596e8b4a0ca52441af7cf96210/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:42:39.703422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c91e36-02f1-4e64-b763-48a2d11ef2fe admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:39.722310 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-4320efaf-091c-4f23-8866-7ede23052809 None None] MFA Rules not processed for user `055c7a51e3f4415e8cf4ccc3cd446df2`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:39.723614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-4320efaf-091c-4f23-8866-7ede23052809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:39.802327 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c91e36-02f1-4e64-b763-48a2d11ef2fe admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:39.807223 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fe10d-06e2-419b-bf23-ab02b916fbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:39.807921 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe10d-06e2-419b-bf23-ab02b916fbb0 admin admin] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:39.808364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe10d-06e2-419b-bf23-ab02b916fbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:39.809039 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fe10d-06e2-419b-bf23-ab02b916fbb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:39.809695 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fe10d-06e2-419b-bf23-ab02b916fbb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:39.811294 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fe10d-06e2-419b-bf23-ab02b916fbb0 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:39.826387 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 480/966] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:39 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Oct 22 20:42:39.826592 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 486/966] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:42:39 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 20:42:39.827774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fe10d-06e2-419b-bf23-ab02b916fbb0 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:39.827897 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320efaf-091c-4f23-8866-7ede23052809 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:39.838855 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fe10d-06e2-419b-bf23-ab02b916fbb0 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:39.840638 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4320efaf-091c-4f23-8866-7ede23052809 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:39.844241 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc80179-ccf3-4d6f-922a-167e2f030691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:39.845012 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc80179-ccf3-4d6f-922a-167e2f030691 admin admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:39.845439 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc80179-ccf3-4d6f-922a-167e2f030691 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:39.845776 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc80179-ccf3-4d6f-922a-167e2f030691 admin admin] PATH_INFO: `/v3/projects/c6bc3798385a4b85a0a35d9dad669937/users/d77c07596e8b4a0ca52441af7cf96210/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:39.846193 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dde55-9750-4e59-87d2-830d369e45a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:39.847112 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dde55-9750-4e59-87d2-830d369e45a9 admin admin] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:39.847710 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dde55-9750-4e59-87d2-830d369e45a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:39.848178 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144dde55-9750-4e59-87d2-830d369e45a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:39.848591 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc80179-ccf3-4d6f-922a-167e2f030691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6bc3798385a4b85a0a35d9dad669937, user_id=d77c07596e8b4a0ca52441af7cf96210, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:39.849234 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dde55-9750-4e59-87d2-830d369e45a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:39.851463 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144dde55-9750-4e59-87d2-830d369e45a9 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:39.852311 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc80179-ccf3-4d6f-922a-167e2f030691 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:39.866530 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 487/967] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Oct 22 20:42:39 2022] PUT /identity/v3/projects/c6bc3798385a4b85a0a35d9dad669937/users/d77c07596e8b4a0ca52441af7cf96210/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:42:39.888210 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 481/968] 10.222.0.39 () {60 vars in 1153 bytes} [Sat Oct 22 20:42:39 2022] POST /identity/v3/projects => generated 383 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:42:39.891999 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc80179-ccf3-4d6f-922a-167e2f030691 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:39.971911 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc80179-ccf3-4d6f-922a-167e2f030691 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:40.059312 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204beb3-2a4f-47fc-abe6-e23ff0cbd327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:40.059954 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204beb3-2a4f-47fc-abe6-e23ff0cbd327 admin admin] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:40.060234 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204beb3-2a4f-47fc-abe6-e23ff0cbd327 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:40.060500 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a204beb3-2a4f-47fc-abe6-e23ff0cbd327 admin admin] PATH_INFO: `/v3/users` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:40.061229 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204beb3-2a4f-47fc-abe6-e23ff0cbd327 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:40.064093 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a204beb3-2a4f-47fc-abe6-e23ff0cbd327 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:40.121861 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 488/969] 10.222.0.39 () {60 vars in 1144 bytes} [Sat Oct 22 20:42:39 2022] POST /identity/v3/users => generated 298 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Oct 22 20:42:40.125594 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dde55-9750-4e59-87d2-830d369e45a9 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:40.139528 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144dde55-9750-4e59-87d2-830d369e45a9 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:40.145419 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff7bd5-a766-409b-aad1-91d63f0530f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:40.146236 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff7bd5-a766-409b-aad1-91d63f0530f4 admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:40.146645 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff7bd5-a766-409b-aad1-91d63f0530f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:40.146976 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ff7bd5-a766-409b-aad1-91d63f0530f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:40.147764 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff7bd5-a766-409b-aad1-91d63f0530f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:40.152234 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ff7bd5-a766-409b-aad1-91d63f0530f4 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:40.167251 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 482/970] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 20:42:40.168609 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204beb3-2a4f-47fc-abe6-e23ff0cbd327 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:40.177409 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:40.184320 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a204beb3-2a4f-47fc-abe6-e23ff0cbd327 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:40.191501 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d781-31e4-46d6-a96d-d17039682175 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:40.192389 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d781-31e4-46d6-a96d-d17039682175 admin admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:40.192792 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d781-31e4-46d6-a96d-d17039682175 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:40.192910 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb3d781-31e4-46d6-a96d-d17039682175 admin admin] PATH_INFO: `/v3/projects/a541614728734be7b9fcb857ed33dab8/users/3ac28f084ca943638244e21650921f1e/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:40.218734 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d781-31e4-46d6-a96d-d17039682175 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a541614728734be7b9fcb857ed33dab8, user_id=3ac28f084ca943638244e21650921f1e, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:40.224336 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb3d781-31e4-46d6-a96d-d17039682175 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:40.247332 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 489/971] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Oct 22 20:42:40 2022] PUT /identity/v3/projects/a541614728734be7b9fcb857ed33dab8/users/3ac28f084ca943638244e21650921f1e/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:42:40.248511 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff7bd5-a766-409b-aad1-91d63f0530f4 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:40.260302 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ff7bd5-a766-409b-aad1-91d63f0530f4 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:40.271084 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:40.345964 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95875e70-46af-4a65-acd2-63755729db2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:40.346593 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875e70-46af-4a65-acd2-63755729db2d admin admin] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:40.346869 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875e70-46af-4a65-acd2-63755729db2d admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:40.347130 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95875e70-46af-4a65-acd2-63755729db2d admin admin] PATH_INFO: `/v3/roles` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:40.347798 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875e70-46af-4a65-acd2-63755729db2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:40.356299 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95875e70-46af-4a65-acd2-63755729db2d admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:40.390847 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 483/972] 10.222.0.39 () {58 vars in 1122 bytes} [Sat Oct 22 20:42:40 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Oct 22 20:42:40.392018 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d781-31e4-46d6-a96d-d17039682175 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:40.407541 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb3d781-31e4-46d6-a96d-d17039682175 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:40.419752 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67f643-2461-421b-a735-7430d10485e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:40.420724 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f643-2461-421b-a735-7430d10485e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:40.421045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f643-2461-421b-a735-7430d10485e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:40.421901 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b67f643-2461-421b-a735-7430d10485e5 admin admin] PATH_INFO: `/v3/projects/a541614728734be7b9fcb857ed33dab8/users/3ac28f084ca943638244e21650921f1e/roles/7fb86065b4ef4b98873a590a9c66cfdc` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:40.435000 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67f643-2461-421b-a735-7430d10485e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a541614728734be7b9fcb857ed33dab8, user_id=3ac28f084ca943638244e21650921f1e, role_id=7fb86065b4ef4b98873a590a9c66cfdc)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:40.439912 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b67f643-2461-421b-a735-7430d10485e5 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:40.464722 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 490/973] 10.222.0.39 () {60 vars in 1483 bytes} [Sat Oct 22 20:42:40 2022] PUT /identity/v3/projects/a541614728734be7b9fcb857ed33dab8/users/3ac28f084ca943638244e21650921f1e/roles/7fb86065b4ef4b98873a590a9c66cfdc => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:42:45.648639 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebbc77-a8ab-4cc0-9ab8-4f1374a720ad None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:45.649125 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebbc77-a8ab-4cc0-9ab8-4f1374a720ad None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:45.649389 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebbc77-a8ab-4cc0-9ab8-4f1374a720ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:45.722247 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-0cebbc77-a8ab-4cc0-9ab8-4f1374a720ad None None] MFA Rules not processed for user `d77c07596e8b4a0ca52441af7cf96210`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:45.724787 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-0cebbc77-a8ab-4cc0-9ab8-4f1374a720ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:45.861871 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 484/974] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:45 2022] POST /identity/v3/auth/tokens => generated 2881 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:45.880602 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67f643-2461-421b-a735-7430d10485e5 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:45.882478 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-7b67f643-2461-421b-a735-7430d10485e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:45.982179 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b67f643-2461-421b-a735-7430d10485e5 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:45.988105 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491eb67-a9fb-49db-8276-ce2cf1bfc9b8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a843b5fd164017b662b4a3eafc8ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:45.988743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491eb67-a9fb-49db-8276-ce2cf1bfc9b8 service glance] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:45.989016 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491eb67-a9fb-49db-8276-ce2cf1bfc9b8 service glance] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:45.989279 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a491eb67-a9fb-49db-8276-ce2cf1bfc9b8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:46.074231 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491eb67-a9fb-49db-8276-ce2cf1bfc9b8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:46.075681 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a491eb67-a9fb-49db-8276-ce2cf1bfc9b8 service glance] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:46.089837 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 491/975] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:42:45 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:42:46.430152 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994df7b-5b5f-456f-9a86-081108bf07a3 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:46.430445 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994df7b-5b5f-456f-9a86-081108bf07a3 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:46.430722 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0994df7b-5b5f-456f-9a86-081108bf07a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:46.474545 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-0994df7b-5b5f-456f-9a86-081108bf07a3 None None] MFA Rules not processed for user `3ac28f084ca943638244e21650921f1e`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:46.475854 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-0994df7b-5b5f-456f-9a86-081108bf07a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:46.584004 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 485/976] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:46 2022] POST /identity/v3/auth/tokens => generated 2887 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:46.596929 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491eb67-a9fb-49db-8276-ce2cf1bfc9b8 service glance] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:46.611472 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a491eb67-a9fb-49db-8276-ce2cf1bfc9b8 service glance] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:46.618103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483b30d5-0e7b-4478-8be7-a534607087b6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a843b5fd164017b662b4a3eafc8ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:46.618809 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b30d5-0e7b-4478-8be7-a534607087b6 service glance] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:46.619535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b30d5-0e7b-4478-8be7-a534607087b6 service glance] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:46.619868 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483b30d5-0e7b-4478-8be7-a534607087b6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:46.721229 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b30d5-0e7b-4478-8be7-a534607087b6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:46.723181 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483b30d5-0e7b-4478-8be7-a534607087b6 service glance] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:46.747423 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 492/977] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:42:46 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:42:54.862994 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57672ce6-529f-4c61-9f59-906a2ca62fc7 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:54.862994 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57672ce6-529f-4c61-9f59-906a2ca62fc7 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:54.863647 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57672ce6-529f-4c61-9f59-906a2ca62fc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:54.884732 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-57672ce6-529f-4c61-9f59-906a2ca62fc7 None None] MFA Rules not processed for user `055c7a51e3f4415e8cf4ccc3cd446df2`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:54.885961 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-57672ce6-529f-4c61-9f59-906a2ca62fc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:54.900333 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 486/978] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:42:54 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:55.190856 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1e69-6591-41db-a01d-fe0f15afef39 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:55.192004 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1e69-6591-41db-a01d-fe0f15afef39 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:55.192672 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ae1e69-6591-41db-a01d-fe0f15afef39 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:55.194717 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 493/979] 10.222.0.39 () {54 vars in 961 bytes} [Sat Oct 22 20:42:55 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:42:55.200734 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fdaa4-612a-4fc7-a6e6-c184d2ac3027 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:55.201307 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fdaa4-612a-4fc7-a6e6-c184d2ac3027 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:55.201579 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fdaa4-612a-4fc7-a6e6-c184d2ac3027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:55.230930 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=100 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:55.250565 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-125fdaa4-612a-4fc7-a6e6-c184d2ac3027 None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:55.251934 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-125fdaa4-612a-4fc7-a6e6-c184d2ac3027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:55.330985 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 487/980] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Oct 22 20:42:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:55.336745 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cae44b-540b-4ff5-b382-c1987e78b6a9 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:55.337030 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cae44b-540b-4ff5-b382-c1987e78b6a9 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:55.337302 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cae44b-540b-4ff5-b382-c1987e78b6a9 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:55.338626 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 494/981] 10.222.0.39 () {54 vars in 912 bytes} [Sat Oct 22 20:42:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:42:55.344319 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bb1e-e07b-44b0-9c22-5cc0b5ec7f49 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:55.344601 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bb1e-e07b-44b0-9c22-5cc0b5ec7f49 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:55.344917 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b8bb1e-e07b-44b0-9c22-5cc0b5ec7f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:55.370035 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-94b8bb1e-e07b-44b0-9c22-5cc0b5ec7f49 None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:55.371672 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-94b8bb1e-e07b-44b0-9c22-5cc0b5ec7f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:55.383777 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 488/982] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Oct 22 20:42:55 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:55.410814 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cae44b-540b-4ff5-b382-c1987e78b6a9 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:55.412654 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-76cae44b-540b-4ff5-b382-c1987e78b6a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:55.432015 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76cae44b-540b-4ff5-b382-c1987e78b6a9 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:55.436624 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a13adc-955f-4725-a40e-c368fb040a2f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '54a843b5fd164017b662b4a3eafc8ac0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:55.437389 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a13adc-955f-4725-a40e-c368fb040a2f service glance] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:55.437784 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a13adc-955f-4725-a40e-c368fb040a2f service glance] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:55.438122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a13adc-955f-4725-a40e-c368fb040a2f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:55.448587 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:42:55.451161 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a13adc-955f-4725-a40e-c368fb040a2f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:55.456267 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a13adc-955f-4725-a40e-c368fb040a2f service glance] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:55.473886 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 495/983] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:42:55 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:42:55.856761 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40549d6-2787-4731-bd21-b5f53c647326 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:55.857042 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40549d6-2787-4731-bd21-b5f53c647326 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:55.857317 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40549d6-2787-4731-bd21-b5f53c647326 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:55.858822 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 489/984] 10.222.0.39 () {54 vars in 912 bytes} [Sat Oct 22 20:42:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:42:55.864882 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2265b-4de6-41cd-9acb-2c811f9425ad None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:55.865802 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2265b-4de6-41cd-9acb-2c811f9425ad None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:55.865802 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c2265b-4de6-41cd-9acb-2c811f9425ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:55.921858 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-68c2265b-4de6-41cd-9acb-2c811f9425ad None None] MFA Rules not processed for user `7f526e9ac6094156aa57f280c4de4f29`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:55.924422 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-68c2265b-4de6-41cd-9acb-2c811f9425ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:56.019430 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 496/985] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Oct 22 20:42:55 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:56.025422 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40549d6-2787-4731-bd21-b5f53c647326 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:56.056043 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40549d6-2787-4731-bd21-b5f53c647326 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:56.064072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce475ff3-04bc-4775-bcbf-000db219e493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:56.064621 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce475ff3-04bc-4775-bcbf-000db219e493 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:56.064891 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce475ff3-04bc-4775-bcbf-000db219e493 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:56.065153 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce475ff3-04bc-4775-bcbf-000db219e493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:56.074823 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce475ff3-04bc-4775-bcbf-000db219e493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:56.076337 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce475ff3-04bc-4775-bcbf-000db219e493 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:56.087150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 490/986] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:42:56 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:42:56.595765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94621-ecc6-4b83-8e34-119674e3b0fb None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:56.596326 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94621-ecc6-4b83-8e34-119674e3b0fb None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:56.596875 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec94621-ecc6-4b83-8e34-119674e3b0fb None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:56.600318 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 497/987] 10.222.0.39 () {54 vars in 961 bytes} [Sat Oct 22 20:42:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:42:56.606882 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce475ff3-04bc-4775-bcbf-000db219e493 service neutron] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:56.620611 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eed01-f44a-45b4-a9f3-bb0e00d6b3a2 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:56.620888 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eed01-f44a-45b4-a9f3-bb0e00d6b3a2 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:56.621153 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227eed01-f44a-45b4-a9f3-bb0e00d6b3a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:56.656662 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-227eed01-f44a-45b4-a9f3-bb0e00d6b3a2 None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:56.657949 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-227eed01-f44a-45b4-a9f3-bb0e00d6b3a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:56.688496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 498/988] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Oct 22 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:56.694231 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb5f5f-7d57-4d4b-a073-1d80a39a01e0 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:56.694986 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb5f5f-7d57-4d4b-a073-1d80a39a01e0 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:56.695774 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb5f5f-7d57-4d4b-a073-1d80a39a01e0 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:56.698142 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 499/989] 10.222.0.39 () {54 vars in 912 bytes} [Sat Oct 22 20:42:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Oct 22 20:42:56.703035 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5863027-0382-4b3a-9932-000aeb74dc5a None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:56.703800 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5863027-0382-4b3a-9932-000aeb74dc5a None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:56.704416 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5863027-0382-4b3a-9932-000aeb74dc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:56.723128 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce475ff3-04bc-4775-bcbf-000db219e493 service neutron] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:56.732271 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-b5863027-0382-4b3a-9932-000aeb74dc5a None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:42:56.734827 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-b5863027-0382-4b3a-9932-000aeb74dc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:56.736434 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738813de-5841-4bf8-8d3c-c833a6073463 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b73c8f104d7476294921098cec0a8bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:56.737037 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738813de-5841-4bf8-8d3c-c833a6073463 service placement] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:56.737310 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738813de-5841-4bf8-8d3c-c833a6073463 service placement] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:56.737576 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738813de-5841-4bf8-8d3c-c833a6073463 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:56.741397 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-738813de-5841-4bf8-8d3c-c833a6073463 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:42:56.754008 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 500/990] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Oct 22 20:42:56 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:42:56.757145 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738813de-5841-4bf8-8d3c-c833a6073463 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:56.758781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738813de-5841-4bf8-8d3c-c833a6073463 service placement] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:56.770504 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 491/991] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:42:56 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:42:56.775397 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5863027-0382-4b3a-9932-000aeb74dc5a None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:42:56.789088 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5863027-0382-4b3a-9932-000aeb74dc5a None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:42:56.795129 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed360276-43c6-41b7-8b19-413f7b5a2411 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:42:56.796217 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360276-43c6-41b7-8b19-413f7b5a2411 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:42:56.796762 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360276-43c6-41b7-8b19-413f7b5a2411 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:42:56.798019 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed360276-43c6-41b7-8b19-413f7b5a2411 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:42:56.813033 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed360276-43c6-41b7-8b19-413f7b5a2411 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:42:56.815555 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed360276-43c6-41b7-8b19-413f7b5a2411 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:42:56.843916 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 501/992] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:42:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:43:06.765890 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=69 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:43:06.824105 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=42 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:43:07.117284 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780717-4930-46ff-b6af-1cb61ccda102 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:07.117571 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780717-4930-46ff-b6af-1cb61ccda102 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:07.117842 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21780717-4930-46ff-b6af-1cb61ccda102 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:07.138643 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-21780717-4930-46ff-b6af-1cb61ccda102 None None] MFA Rules not processed for user `7f526e9ac6094156aa57f280c4de4f29`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:43:07.139964 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-21780717-4930-46ff-b6af-1cb61ccda102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:43:07.146670 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 492/993] 10.222.0.26 () {58 vars in 1015 bytes} [Sat Oct 22 20:43:07 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:43:07.159455 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed360276-43c6-41b7-8b19-413f7b5a2411 service neutron] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:43:07.168308 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed360276-43c6-41b7-8b19-413f7b5a2411 service neutron] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:43:07.171895 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9816b4c3-197e-41ba-bfdc-dcdbcf5d4488 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:43:07.172496 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816b4c3-197e-41ba-bfdc-dcdbcf5d4488 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:07.172770 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816b4c3-197e-41ba-bfdc-dcdbcf5d4488 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:07.173041 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9816b4c3-197e-41ba-bfdc-dcdbcf5d4488 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:07.180110 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816b4c3-197e-41ba-bfdc-dcdbcf5d4488 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:43:07.181538 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9816b4c3-197e-41ba-bfdc-dcdbcf5d4488 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:43:07.189190 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 502/994] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:43:07 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 30 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:43:08.173109 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894dad6-9cd9-411c-9d10-dcdf72d0762b None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:08.173688 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894dad6-9cd9-411c-9d10-dcdf72d0762b None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:08.173688 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3894dad6-9cd9-411c-9d10-dcdf72d0762b None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:08.175195 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 493/995] 10.222.0.39 () {54 vars in 921 bytes} [Sat Oct 22 20:43:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:43:08.210685 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf24320-e8c7-4a18-b8c1-9b4bbf07c52d None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:08.211318 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf24320-e8c7-4a18-b8c1-9b4bbf07c52d None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:08.211428 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf24320-e8c7-4a18-b8c1-9b4bbf07c52d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:08.232623 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-4bf24320-e8c7-4a18-b8c1-9b4bbf07c52d None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:43:08.233908 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-4bf24320-e8c7-4a18-b8c1-9b4bbf07c52d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:43:08.243773 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 503/996] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Oct 22 20:43:08 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:43:08.262879 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894dad6-9cd9-411c-9d10-dcdf72d0762b None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:43:08.279633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3894dad6-9cd9-411c-9d10-dcdf72d0762b None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:43:08.286466 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9892e8bf-b687-45b9-8a2e-dc7ad0238be6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:43:08.287187 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e8bf-b687-45b9-8a2e-dc7ad0238be6 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:08.287568 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e8bf-b687-45b9-8a2e-dc7ad0238be6 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:08.287908 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9892e8bf-b687-45b9-8a2e-dc7ad0238be6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:08.298370 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892e8bf-b687-45b9-8a2e-dc7ad0238be6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:43:08.300574 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9892e8bf-b687-45b9-8a2e-dc7ad0238be6 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:43:08.312244 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 494/997] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:43:08 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:43:13.688816 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca50a3-e5f1-4e95-a5e8-c23b9a635123 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:13.689448 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca50a3-e5f1-4e95-a5e8-c23b9a635123 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:13.689448 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eca50a3-e5f1-4e95-a5e8-c23b9a635123 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:13.690959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 504/998] 10.222.0.39 () {54 vars in 921 bytes} [Sat Oct 22 20:43:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:43:13.701781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e9194-8a72-471f-9587-4a2ccef9f063 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:13.702625 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e9194-8a72-471f-9587-4a2ccef9f063 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:13.702882 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e9194-8a72-471f-9587-4a2ccef9f063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:13.734485 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-414e9194-8a72-471f-9587-4a2ccef9f063 None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:43:13.735753 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-414e9194-8a72-471f-9587-4a2ccef9f063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:43:13.744634 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 495/999] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Oct 22 20:43:13 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:43:13.760962 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca50a3-e5f1-4e95-a5e8-c23b9a635123 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:43:13.777098 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eca50a3-e5f1-4e95-a5e8-c23b9a635123 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:43:13.782703 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9213c53-3f1b-4c29-bdc4-5612d8a90025 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:43:13.783603 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9213c53-3f1b-4c29-bdc4-5612d8a90025 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:13.783874 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9213c53-3f1b-4c29-bdc4-5612d8a90025 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:13.784334 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9213c53-3f1b-4c29-bdc4-5612d8a90025 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:13.793969 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9213c53-3f1b-4c29-bdc4-5612d8a90025 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:43:13.795811 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9213c53-3f1b-4c29-bdc4-5612d8a90025 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:43:13.806307 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 505/1000] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:43:13 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:43:23.719347 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=12 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:43:23.802016 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=15 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:43:25.040924 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e9194-8a72-471f-9587-4a2ccef9f063 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:43:25.050437 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e9194-8a72-471f-9587-4a2ccef9f063 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:43:25.054016 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79289a01-4134-4bbc-9feb-a30d55c7cff5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:43:25.054612 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79289a01-4134-4bbc-9feb-a30d55c7cff5 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:25.054885 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79289a01-4134-4bbc-9feb-a30d55c7cff5 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:25.055306 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79289a01-4134-4bbc-9feb-a30d55c7cff5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:25.065018 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79289a01-4134-4bbc-9feb-a30d55c7cff5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:43:25.066651 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79289a01-4134-4bbc-9feb-a30d55c7cff5 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:43:25.077032 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 496/1001] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:43:25 2022] GET /identity/v3/auth/tokens => generated 2887 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:43:35.072357 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=6 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:43:45.110831 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026602f5-f78f-46ca-aad8-78f7c1bc3161 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:45.111444 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026602f5-f78f-46ca-aad8-78f7c1bc3161 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:45.111444 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026602f5-f78f-46ca-aad8-78f7c1bc3161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:45.137841 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-026602f5-f78f-46ca-aad8-78f7c1bc3161 None None] MFA Rules not processed for user `7190888d97de4cc685ac073e41601ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:43:45.139054 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-026602f5-f78f-46ca-aad8-78f7c1bc3161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:43:45.147365 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 506/1002] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:43:45 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:43:45.482653 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ff4a2-df99-470e-821f-df70fdaab127 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:45.483205 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ff4a2-df99-470e-821f-df70fdaab127 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:45.483205 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ff4a2-df99-470e-821f-df70fdaab127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:45.506714 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-844ff4a2-df99-470e-821f-df70fdaab127 None None] MFA Rules not processed for user `7f526e9ac6094156aa57f280c4de4f29`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:43:45.507975 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-844ff4a2-df99-470e-821f-df70fdaab127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:43:45.515205 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 497/1003] 10.222.0.39 () {58 vars in 1009 bytes} [Sat Oct 22 20:43:45 2022] POST /identity/v3/auth/tokens => generated 2681 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:43:45.526550 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026602f5-f78f-46ca-aad8-78f7c1bc3161 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:43:45.537341 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026602f5-f78f-46ca-aad8-78f7c1bc3161 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:43:45.541864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99da58-97fd-4dcc-874d-ebec2029d3af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:43:45.542490 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99da58-97fd-4dcc-874d-ebec2029d3af service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:43:45.542760 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99da58-97fd-4dcc-874d-ebec2029d3af service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:43:45.543023 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99da58-97fd-4dcc-874d-ebec2029d3af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:43:45.550858 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99da58-97fd-4dcc-874d-ebec2029d3af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:43:45.552325 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc99da58-97fd-4dcc-874d-ebec2029d3af service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:43:45.560007 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 507/1004] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:43:45 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:43:55.501770 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:43:55.556949 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=9 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:44:07.445617 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bfde9-2d2b-446c-9e44-d591aafbf5a6 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:44:07.446192 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bfde9-2d2b-446c-9e44-d591aafbf5a6 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:44:07.446192 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6bfde9-2d2b-446c-9e44-d591aafbf5a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:44:07.467376 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-ca6bfde9-2d2b-446c-9e44-d591aafbf5a6 None None] MFA Rules not processed for user `7190888d97de4cc685ac073e41601ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:44:07.468577 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-ca6bfde9-2d2b-446c-9e44-d591aafbf5a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:44:07.478128 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 498/1005] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:44:07 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:44:17.462049 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:44:22.391434 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca078c4-52a2-41a3-8469-8da697c4a64d None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:44:22.391968 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca078c4-52a2-41a3-8469-8da697c4a64d None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:44:22.391968 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca078c4-52a2-41a3-8469-8da697c4a64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:44:22.413172 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-cca078c4-52a2-41a3-8469-8da697c4a64d None None] MFA Rules not processed for user `7190888d97de4cc685ac073e41601ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:44:22.414370 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-cca078c4-52a2-41a3-8469-8da697c4a64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:44:22.422519 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 508/1006] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:44:22 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:44:32.407960 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=3 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:45:18.018326 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d34e82-8257-4af2-977c-dcd2c99b840f None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:45:18.018781 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d34e82-8257-4af2-977c-dcd2c99b840f None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:45:18.018864 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d34e82-8257-4af2-977c-dcd2c99b840f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:45:18.037989 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-14d34e82-8257-4af2-977c-dcd2c99b840f None None] MFA Rules not processed for user `7190888d97de4cc685ac073e41601ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:45:18.039165 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-14d34e82-8257-4af2-977c-dcd2c99b840f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:45:18.050805 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 499/1007] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:45:18 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:45:28.033150 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:45:31.066408 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca078c4-52a2-41a3-8469-8da697c4a64d None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:45:31.086868 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca078c4-52a2-41a3-8469-8da697c4a64d None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:45:31.092147 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd29b81-a2f8-4e66-8a10-11a4418a3ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:45:31.092753 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd29b81-a2f8-4e66-8a10-11a4418a3ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:45:31.093027 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd29b81-a2f8-4e66-8a10-11a4418a3ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:45:31.093293 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd29b81-a2f8-4e66-8a10-11a4418a3ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:45:31.103106 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd29b81-a2f8-4e66-8a10-11a4418a3ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:45:31.104931 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd29b81-a2f8-4e66-8a10-11a4418a3ec4 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:45:31.114702 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 509/1008] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:45:31 2022] GET /identity/v3/auth/tokens => generated 2881 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:45:33.156834 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c7e0-32de-428f-9849-42508db2f99b None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:45:33.157386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c7e0-32de-428f-9849-42508db2f99b None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:45:33.157386 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec72c7e0-32de-428f-9849-42508db2f99b None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:45:33.158630 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 500/1009] 10.222.0.39 () {54 vars in 921 bytes} [Sat Oct 22 20:45:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:45:33.163623 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eeea0-d99e-4b06-bc4f-afdfe50aa394 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:45:33.164070 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eeea0-d99e-4b06-bc4f-afdfe50aa394 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:45:33.164149 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eeea0-d99e-4b06-bc4f-afdfe50aa394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:45:33.199847 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-471eeea0-d99e-4b06-bc4f-afdfe50aa394 None None] MFA Rules not processed for user `a3b1e73612ed4e4c83784e77194d20e1`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:45:33.201095 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-471eeea0-d99e-4b06-bc4f-afdfe50aa394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:45:33.212140 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 510/1010] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Oct 22 20:45:33 2022] POST /identity/v3/auth/tokens => generated 2863 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:45:33.223845 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c7e0-32de-428f-9849-42508db2f99b None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:45:33.238700 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec72c7e0-32de-428f-9849-42508db2f99b None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:45:33.243596 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1819542-84d1-48ad-b327-a0611df5fd80 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:45:33.244191 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1819542-84d1-48ad-b327-a0611df5fd80 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:45:33.244453 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1819542-84d1-48ad-b327-a0611df5fd80 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:45:33.244715 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1819542-84d1-48ad-b327-a0611df5fd80 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:45:33.253065 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1819542-84d1-48ad-b327-a0611df5fd80 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:45:33.254658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1819542-84d1-48ad-b327-a0611df5fd80 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:45:33.264466 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 501/1011] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:45:33 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:45:43.194781 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=17 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:45:43.260276 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=6 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:46:01.022443 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f420a-d7e1-486d-8886-6478cb13cf7a None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:46:01.022891 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f420a-d7e1-486d-8886-6478cb13cf7a None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:46:01.023103 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836f420a-d7e1-486d-8886-6478cb13cf7a None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:46:01.024615 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 511/1012] 10.222.0.39 () {54 vars in 961 bytes} [Sat Oct 22 20:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:46:01.030045 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbb56c-545f-4cd4-848e-bb38d46d5cb4 None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:46:01.030476 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbb56c-545f-4cd4-848e-bb38d46d5cb4 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:46:01.030619 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cbb56c-545f-4cd4-848e-bb38d46d5cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:46:01.085302 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-e1cbb56c-545f-4cd4-848e-bb38d46d5cb4 None None] MFA Rules not processed for user `9b73c8f104d7476294921098cec0a8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:46:01.086541 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-e1cbb56c-545f-4cd4-848e-bb38d46d5cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:46:01.108042 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 502/1013] 10.222.0.39 () {58 vars in 1058 bytes} [Sat Oct 22 20:46:01 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:46:01.115956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f420a-d7e1-486d-8886-6478cb13cf7a None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:46:01.131074 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836f420a-d7e1-486d-8886-6478cb13cf7a None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:46:01.136529 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1e06d1-9f11-4001-aa51-7040ac92eb4d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b73c8f104d7476294921098cec0a8bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:46:01.137124 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e06d1-9f11-4001-aa51-7040ac92eb4d service placement] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:46:01.137475 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e06d1-9f11-4001-aa51-7040ac92eb4d service placement] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:46:01.137711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1e06d1-9f11-4001-aa51-7040ac92eb4d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:46:01.146696 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e06d1-9f11-4001-aa51-7040ac92eb4d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:46:01.148642 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1e06d1-9f11-4001-aa51-7040ac92eb4d service placement] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:46:01.159405 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 512/1014] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:46:01 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:46:11.104698 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=18 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:46:11.155361 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=6 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:16.469072 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777494d9-bb98-45f8-b4db-6e5072eab8df None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:47:16.469567 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777494d9-bb98-45f8-b4db-6e5072eab8df None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:47:16.469660 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777494d9-bb98-45f8-b4db-6e5072eab8df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:47:16.489556 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-777494d9-bb98-45f8-b4db-6e5072eab8df None None] MFA Rules not processed for user `055c7a51e3f4415e8cf4ccc3cd446df2`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:47:16.490759 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-777494d9-bb98-45f8-b4db-6e5072eab8df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:47:16.498182 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 503/1015] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:47:16 2022] POST /identity/v3/auth/tokens => generated 2822 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:47:26.484546 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=3 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:43.364867 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b52b-72a1-4c6c-ba76-def0528c1c88 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:47:43.365385 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b52b-72a1-4c6c-ba76-def0528c1c88 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:47:43.365385 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4b52b-72a1-4c6c-ba76-def0528c1c88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:47:43.384998 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-77b4b52b-72a1-4c6c-ba76-def0528c1c88 None None] MFA Rules not processed for user `7190888d97de4cc685ac073e41601ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:47:43.386195 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-77b4b52b-72a1-4c6c-ba76-def0528c1c88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:47:43.393094 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 513/1016] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:47:43 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:47:45.520800 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777494d9-bb98-45f8-b4db-6e5072eab8df None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:47:45.537900 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4b52b-72a1-4c6c-ba76-def0528c1c88 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:47:45.542922 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777494d9-bb98-45f8-b4db-6e5072eab8df None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:47:45.554436 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8157e-bb9d-478a-ba7c-46c9e7219c56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:47:45.555491 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8157e-bb9d-478a-ba7c-46c9e7219c56 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:47:45.555767 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8157e-bb9d-478a-ba7c-46c9e7219c56 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:47:45.556031 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa8157e-bb9d-478a-ba7c-46c9e7219c56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:47:45.580604 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8157e-bb9d-478a-ba7c-46c9e7219c56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:47:45.581706 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4b52b-72a1-4c6c-ba76-def0528c1c88 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:47:45.582131 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa8157e-bb9d-478a-ba7c-46c9e7219c56 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:47:45.597093 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a6d4b-8dba-4ea0-b9f1-8b1772a4e369 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:47:45.597983 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6d4b-8dba-4ea0-b9f1-8b1772a4e369 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:47:45.598408 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6d4b-8dba-4ea0-b9f1-8b1772a4e369 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:47:45.598813 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6a6d4b-8dba-4ea0-b9f1-8b1772a4e369 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:47:45.603909 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 504/1017] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:47:45 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:47:45.623702 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a6d4b-8dba-4ea0-b9f1-8b1772a4e369 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:47:45.625711 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6a6d4b-8dba-4ea0-b9f1-8b1772a4e369 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:47:45.660865 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 514/1018] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:47:45 2022] GET /identity/v3/auth/tokens => generated 2816 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:47:46.005457 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8157e-bb9d-478a-ba7c-46c9e7219c56 service neutron] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:47:46.017557 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa8157e-bb9d-478a-ba7c-46c9e7219c56 service neutron] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:47:46.022169 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a4401-de73-459f-9af0-55314b0db97f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:47:46.023850 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a4401-de73-459f-9af0-55314b0db97f service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:47:46.024508 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a4401-de73-459f-9af0-55314b0db97f service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:47:46.025011 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70a4401-de73-459f-9af0-55314b0db97f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:47:46.035718 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a4401-de73-459f-9af0-55314b0db97f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:47:46.037933 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70a4401-de73-459f-9af0-55314b0db97f service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:47:46.049487 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 505/1019] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:47:46 2022] GET /identity/v3/auth/tokens => generated 2822 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:47:54.368680 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a6d4b-8dba-4ea0-b9f1-8b1772a4e369 service nova] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:47:54.379055 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6a6d4b-8dba-4ea0-b9f1-8b1772a4e369 service nova] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:47:54.383644 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b5505-db0c-4584-98f5-a49dcbb43ed1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:47:54.384235 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b5505-db0c-4584-98f5-a49dcbb43ed1 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:47:54.384504 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b5505-db0c-4584-98f5-a49dcbb43ed1 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:47:54.384769 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7b5505-db0c-4584-98f5-a49dcbb43ed1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:47:54.395504 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b5505-db0c-4584-98f5-a49dcbb43ed1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:47:54.397056 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7b5505-db0c-4584-98f5-a49dcbb43ed1 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:47:54.407952 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 515/1020] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:47:54 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:47:56.044111 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=12 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:47:56.794797 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a4401-de73-459f-9af0-55314b0db97f service neutron] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:47:56.803542 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70a4401-de73-459f-9af0-55314b0db97f service neutron] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:47:56.807974 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7340934-b0ce-4373-9468-562dd47c561a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:47:56.808559 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340934-b0ce-4373-9468-562dd47c561a service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:47:56.808827 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340934-b0ce-4373-9468-562dd47c561a service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:47:56.809089 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7340934-b0ce-4373-9468-562dd47c561a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:47:56.819045 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7340934-b0ce-4373-9468-562dd47c561a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:47:56.820515 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7340934-b0ce-4373-9468-562dd47c561a service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:47:56.830474 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 506/1021] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:47:56 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:48:04.403319 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=19 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:06.826325 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=6 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:48:11.822474 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b5505-db0c-4584-98f5-a49dcbb43ed1 service neutron] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:48:11.831576 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7b5505-db0c-4584-98f5-a49dcbb43ed1 service neutron] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:48:11.835629 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe388a-0ba4-4a0a-8699-78f2ff0af07e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:48:11.836316 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe388a-0ba4-4a0a-8699-78f2ff0af07e service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:48:11.836656 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe388a-0ba4-4a0a-8699-78f2ff0af07e service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:48:11.836986 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe388a-0ba4-4a0a-8699-78f2ff0af07e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:48:11.845033 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe388a-0ba4-4a0a-8699-78f2ff0af07e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:48:11.846537 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe388a-0ba4-4a0a-8699-78f2ff0af07e service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:48:11.855939 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 516/1022] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:48:11 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:48:21.851793 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=6 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:01.662794 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7340934-b0ce-4373-9468-562dd47c561a service neutron] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:01.676045 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7340934-b0ce-4373-9468-562dd47c561a service neutron] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:01.683792 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ed512a-eead-49e6-b447-d35201487193 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:01.684740 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed512a-eead-49e6-b447-d35201487193 service nova] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:01.685961 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed512a-eead-49e6-b447-d35201487193 service nova] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:01.686457 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ed512a-eead-49e6-b447-d35201487193 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:01.699792 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed512a-eead-49e6-b447-d35201487193 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:01.702559 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ed512a-eead-49e6-b447-d35201487193 service nova] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:01.720640 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 507/1023] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:49:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:49:09.786410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe388a-0ba4-4a0a-8699-78f2ff0af07e service neutron] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:09.795950 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe388a-0ba4-4a0a-8699-78f2ff0af07e service neutron] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:09.799959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c756a9-f88f-49fe-8972-845030080a01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:09.800669 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c756a9-f88f-49fe-8972-845030080a01 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:09.801045 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c756a9-f88f-49fe-8972-845030080a01 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:09.801397 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c756a9-f88f-49fe-8972-845030080a01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:09.865677 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c756a9-f88f-49fe-8972-845030080a01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:09.867192 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c756a9-f88f-49fe-8972-845030080a01 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:09.887929 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 517/1024] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:49:09 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:49:11.711087 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=6 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:13.189428 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4c806-fcf1-43bd-9275-d5eb0ffb9fe7 None None] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:13.190024 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4c806-fcf1-43bd-9275-d5eb0ffb9fe7 None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:13.190024 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4c806-fcf1-43bd-9275-d5eb0ffb9fe7 None None] PATH_INFO: `/` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:13.191663 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 508/1025] 10.222.0.39 () {54 vars in 921 bytes} [Sat Oct 22 20:49:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:49:13.201477 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d659c78-58fe-4bea-8166-c43300f5b409 None None] REQUEST_METHOD: `POST` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:13.202020 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d659c78-58fe-4bea-8166-c43300f5b409 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:13.202262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d659c78-58fe-4bea-8166-c43300f5b409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:13.222686 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.auth.core [None req-3d659c78-58fe-4bea-8166-c43300f5b409 None None] MFA Rules not processed for user `9b73c8f104d7476294921098cec0a8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88407) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:49:13.223860 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-3d659c78-58fe-4bea-8166-c43300f5b409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:49:13.232632 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 518/1026] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Oct 22 20:49:13 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:49:13.243841 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4c806-fcf1-43bd-9275-d5eb0ffb9fe7 None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:13.257384 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4c806-fcf1-43bd-9275-d5eb0ffb9fe7 None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:13.266467 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da644f3-420b-499e-9163-d42d84e5d39b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b73c8f104d7476294921098cec0a8bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:13.267123 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da644f3-420b-499e-9163-d42d84e5d39b service placement] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:13.267457 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da644f3-420b-499e-9163-d42d84e5d39b service placement] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:13.267755 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da644f3-420b-499e-9163-d42d84e5d39b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:13.285047 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da644f3-420b-499e-9163-d42d84e5d39b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:13.286668 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da644f3-420b-499e-9163-d42d84e5d39b service placement] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:13.297476 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 509/1027] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:49:13 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:49:16.449275 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3f864-5734-45dc-aec1-2b3970ff2208 None None] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:16.449738 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3f864-5734-45dc-aec1-2b3970ff2208 None None] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:16.449932 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a3f864-5734-45dc-aec1-2b3970ff2208 None None] PATH_INFO: `/` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:16.451124 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 519/1028] 10.222.0.39 () {54 vars in 921 bytes} [Sat Oct 22 20:49:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Oct 22 20:49:16.465146 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1505ca-c8e2-496f-8977-c0e7ae24cfbe None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:16.465599 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1505ca-c8e2-496f-8977-c0e7ae24cfbe None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:16.465778 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1505ca-c8e2-496f-8977-c0e7ae24cfbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:16.485258 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-df1505ca-c8e2-496f-8977-c0e7ae24cfbe None None] MFA Rules not processed for user `9b73c8f104d7476294921098cec0a8bf`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:49:16.486520 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-df1505ca-c8e2-496f-8977-c0e7ae24cfbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:49:16.496246 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 510/1029] 10.222.0.39 () {58 vars in 1018 bytes} [Sat Oct 22 20:49:16 2022] POST /identity/v3/auth/tokens => generated 2868 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:49:16.514148 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3f864-5734-45dc-aec1-2b3970ff2208 None None] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:16.529809 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a3f864-5734-45dc-aec1-2b3970ff2208 None None] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:16.532176 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1505ca-c8e2-496f-8977-c0e7ae24cfbe None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:16.535561 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db161f57-8386-4858-bf2d-17e45c4ef304 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b73c8f104d7476294921098cec0a8bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:16.536264 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161f57-8386-4858-bf2d-17e45c4ef304 service placement] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:16.536619 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161f57-8386-4858-bf2d-17e45c4ef304 service placement] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:16.536936 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db161f57-8386-4858-bf2d-17e45c4ef304 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:16.544456 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1505ca-c8e2-496f-8977-c0e7ae24cfbe None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:16.546191 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db161f57-8386-4858-bf2d-17e45c4ef304 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:16.547828 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db161f57-8386-4858-bf2d-17e45c4ef304 service placement] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:16.550389 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:16.551093 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:16.551479 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:16.551819 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] PATH_INFO: `/v3/users/055c7a51e3f4415e8cf4ccc3cd446df2` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:16.553210 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] RBAC: Authorizing `identity:delete_user(user_id=055c7a51e3f4415e8cf4ccc3cd446df2)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:16.554789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: WARNING py.warnings [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:49:16.554789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: warnings.warn(msg) Oct 22 20:49:16.554789 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: Oct 22 20:49:16.556022 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:16.558213 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 520/1030] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:49:16 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:49:16.620850 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '055c7a51e3f4415e8cf4ccc3cd446df2'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:16.631361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '055c7a51e3f4415e8cf4ccc3cd446df2'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:16.650282 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '055c7a51e3f4415e8cf4ccc3cd446df2'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:16.659368 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '055c7a51e3f4415e8cf4ccc3cd446df2'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:16.659993 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '055c7a51e3f4415e8cf4ccc3cd446df2'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:16.665997 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 511/1031] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Oct 22 20:49:16 2022] DELETE /identity/v3/users/055c7a51e3f4415e8cf4ccc3cd446df2 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Oct 22 20:49:16.847970 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db161f57-8386-4858-bf2d-17e45c4ef304 service placement] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:16.860708 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db161f57-8386-4858-bf2d-17e45c4ef304 service placement] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:16.918989 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:16.919657 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] REQUEST_METHOD: `DELETE` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:16.919924 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:16.920200 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] PATH_INFO: `/v3/projects/b181771f533c43cc81a30e41c9976ce3` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:16.921325 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] RBAC: Authorizing `identity:delete_project(project_id=b181771f533c43cc81a30e41c9976ce3)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:16.922348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: WARNING py.warnings [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Oct 22 20:49:16.922348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: warnings.warn(msg) Oct 22 20:49:16.922348 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: Oct 22 20:49:16.923571 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:16.981099 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b181771f533c43cc81a30e41c9976ce3', 'request_id': 'req-54d30d57-ca81-4dae-8673-a5d1ff96f58e'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:16.988440 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b181771f533c43cc81a30e41c9976ce3', 'request_id': 'req-54d30d57-ca81-4dae-8673-a5d1ff96f58e'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:16.998156 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b181771f533c43cc81a30e41c9976ce3', 'request_id': 'req-54d30d57-ca81-4dae-8673-a5d1ff96f58e'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.008184 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:17.018807 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] The token cache is being invalidate because project b181771f533c43cc81a30e41c9976ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 22 20:49:17.019071 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.019751 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.021257 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 521/1032] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Oct 22 20:49:16 2022] DELETE /identity/v3/projects/b181771f533c43cc81a30e41c9976ce3 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:49:17.025429 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:17.027270 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:49:17.041262 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd555ba0-3f84-49f1-805c-f9f80b493205 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:17.099282 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:17.099932 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] REQUEST_METHOD: `DELETE` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:17.100208 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:17.100479 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] PATH_INFO: `/v3/users/3ac28f084ca943638244e21650921f1e` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:17.101636 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ac28f084ca943638244e21650921f1e)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:17.103933 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:17.153426 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ac28f084ca943638244e21650921f1e'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.158483 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:17.160896 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ac28f084ca943638244e21650921f1e'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.174355 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ac28f084ca943638244e21650921f1e'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.183180 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ac28f084ca943638244e21650921f1e'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.183808 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-fd984e6e-fcd0-46df-bd95-7abe42a9b13a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ac28f084ca943638244e21650921f1e'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.189892 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 512/1033] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Oct 22 20:49:17 2022] DELETE /identity/v3/users/3ac28f084ca943638244e21650921f1e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:49:17.553535 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:17.555052 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:49:17.568325 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d30d57-ca81-4dae-8673-a5d1ff96f58e admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:17.627849 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:17.628511 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] REQUEST_METHOD: `DELETE` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:17.628791 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:17.629062 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] PATH_INFO: `/v3/projects/a541614728734be7b9fcb857ed33dab8` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:17.630178 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a541614728734be7b9fcb857ed33dab8)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:17.632150 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:17.681256 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a541614728734be7b9fcb857ed33dab8', 'request_id': 'req-b3a719c8-670d-4477-a744-a11e458f289c'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.686585 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a541614728734be7b9fcb857ed33dab8', 'request_id': 'req-b3a719c8-670d-4477-a744-a11e458f289c'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.696975 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a541614728734be7b9fcb857ed33dab8', 'request_id': 'req-b3a719c8-670d-4477-a744-a11e458f289c'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.711366 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] The token cache is being invalidate because project a541614728734be7b9fcb857ed33dab8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88407) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 22 20:49:17.711648 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.712292 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:49:17.713783 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 522/1034] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Oct 22 20:49:17 2022] DELETE /identity/v3/projects/a541614728734be7b9fcb857ed33dab8 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:49:27.186633 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=9,keystone:DELETE=3,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:27.708796 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:49:52.915825 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006af06-b7a4-42bc-a8af-b325467c4caf None None] REQUEST_METHOD: `POST` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:52.916361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006af06-b7a4-42bc-a8af-b325467c4caf None None] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:52.916361 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b006af06-b7a4-42bc-a8af-b325467c4caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:52.936738 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.auth.core [None req-b006af06-b7a4-42bc-a8af-b325467c4caf None None] MFA Rules not processed for user `7190888d97de4cc685ac073e41601ce4`. Rule list: `[]` (Enabled: `True`). {{(pid=88408) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Oct 22 20:49:52.937941 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-b006af06-b7a4-42bc-a8af-b325467c4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:49:52.995829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 513/1035] 10.222.0.39 () {58 vars in 958 bytes} [Sat Oct 22 20:49:52 2022] POST /identity/v3/auth/tokens => generated 2816 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Oct 22 20:49:53.320157 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:53.321651 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:49:53.387224 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3a719c8-670d-4477-a744-a11e458f289c admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:53.392341 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:53.392987 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:53.393262 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:53.393527 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:53.395410 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:49:53.405063 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:53.406483 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:53.414380 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 523/1036] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:49:53 2022] GET /identity/v3/auth/tokens => generated 2681 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:49:53.869865 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006af06-b7a4-42bc-a8af-b325467c4caf None None] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:49:53.871335 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-b006af06-b7a4-42bc-a8af-b325467c4caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:49:53.941182 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b006af06-b7a4-42bc-a8af-b325467c4caf None None] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:49:53.945965 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b73c8f104d7476294921098cec0a8bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:49:53.946563 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:49:53.946833 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:49:53.947093 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:49:53.948829 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:49:53.959853 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:49:53.961433 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:49:53.970760 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 514/1037] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:49:53 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:50:01.487651 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:50:01.489073 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:50:01.569772 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b366eb-c0e7-4fee-ac0f-5a496c41b767 service neutron] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:50:01.574955 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165bce-0cca-43da-b62b-f6de0d160c7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:50:01.575653 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165bce-0cca-43da-b62b-f6de0d160c7c service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:50:01.575933 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165bce-0cca-43da-b62b-f6de0d160c7c service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:50:01.576199 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f165bce-0cca-43da-b62b-f6de0d160c7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:50:01.578056 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-9f165bce-0cca-43da-b62b-f6de0d160c7c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:50:01.589864 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165bce-0cca-43da-b62b-f6de0d160c7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:50:01.591482 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f165bce-0cca-43da-b62b-f6de0d160c7c service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:50:01.600974 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 524/1038] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:50:01 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:50:03.966967 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=57 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:50:11.597421 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=58 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:06.950272 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:51:06.951869 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:51:07.020875 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0451ba08-5c9a-44bb-9b64-58e826545086 service placement] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:51:07.027222 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b73c8f104d7476294921098cec0a8bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:51:07.027977 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:51:07.028303 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:51:07.028629 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:51:07.030614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:51:07.043567 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:51:07.045342 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:51:07.056561 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 515/1039] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:51:06 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:51:17.051899 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=28 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:51:45.323221 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165bce-0cca-43da-b62b-f6de0d160c7c service nova] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:51:45.375848 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f165bce-0cca-43da-b62b-f6de0d160c7c service nova] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:51:45.380806 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a3b1e73612ed4e4c83784e77194d20e1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:51:45.381517 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:51:45.381797 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:51:45.382066 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:51:45.383878 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:51:45.406106 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:51:45.407760 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:51:45.418666 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 525/1040] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:51:45 2022] GET /identity/v3/auth/tokens => generated 2863 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:51:55.414401 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=20 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:28.825986 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:52:28.827625 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:52:28.839648 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a000cc5-ae5e-4331-8910-6ac6e27021e1 service placement] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:52:28.844232 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc96d43-0e49-4fdd-b5d3-83df90391355 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7f526e9ac6094156aa57f280c4de4f29', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:52:28.844821 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc96d43-0e49-4fdd-b5d3-83df90391355 service neutron] REQUEST_METHOD: `GET` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:52:28.845101 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc96d43-0e49-4fdd-b5d3-83df90391355 service neutron] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:52:28.845360 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc96d43-0e49-4fdd-b5d3-83df90391355 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:52:28.847448 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-ebc96d43-0e49-4fdd-b5d3-83df90391355 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:52:28.930122 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc96d43-0e49-4fdd-b5d3-83df90391355 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:52:28.931614 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc96d43-0e49-4fdd-b5d3-83df90391355 service neutron] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:52:28.941205 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 516/1041] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:52:28 2022] GET /identity/v3/auth/tokens => generated 2799 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:52:35.109951 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:52:35.111539 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:52:35.129959 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509f355a-2cff-4c24-bcf7-57cf83813209 service nova] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:52:35.134831 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:52:35.135488 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:52:35.135765 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:52:35.136035 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] PATH_INFO: `/v3/users/7190888d97de4cc685ac073e41601ce4` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:52:35.150051 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7190888d97de4cc685ac073e41601ce4)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:52:35.152016 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:52:35.197956 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7190888d97de4cc685ac073e41601ce4'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.204520 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7190888d97de4cc685ac073e41601ce4'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.205147 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7190888d97de4cc685ac073e41601ce4'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.216743 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7190888d97de4cc685ac073e41601ce4'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.226096 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7190888d97de4cc685ac073e41601ce4'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.232401 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 526/1042] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Oct 22 20:52:35 2022] DELETE /identity/v3/users/7190888d97de4cc685ac073e41601ce4 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:52:35.410532 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc96d43-0e49-4fdd-b5d3-83df90391355 service neutron] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:52:35.421533 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc96d43-0e49-4fdd-b5d3-83df90391355 service neutron] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:52:35.482494 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:52:35.483118 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:52:35.483421 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:52:35.483690 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] PATH_INFO: `/v3/projects/79da719c506540389257afa26e3b31ad` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:52:35.494321 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79da719c506540389257afa26e3b31ad)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:52:35.496304 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:52:35.555295 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79da719c506540389257afa26e3b31ad', 'request_id': 'req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.563763 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79da719c506540389257afa26e3b31ad', 'request_id': 'req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.570032 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79da719c506540389257afa26e3b31ad', 'request_id': 'req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.572049 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:35.582495 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] The token cache is being invalidate because project 79da719c506540389257afa26e3b31ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 22 20:52:35.582716 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.583861 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.585518 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 517/1043] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Oct 22 20:52:35 2022] DELETE /identity/v3/projects/79da719c506540389257afa26e3b31ad => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:52:35.589843 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:52:35.591965 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:52:35.608992 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a81fec-ea81-4524-ad24-386f144d37e2 admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:52:35.666941 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:52:35.667582 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:52:35.667859 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:52:35.668122 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] PATH_INFO: `/v3/users/d77c07596e8b4a0ca52441af7cf96210` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:52:35.669290 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] RBAC: Authorizing `identity:delete_user(user_id=d77c07596e8b4a0ca52441af7cf96210)` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:52:35.671203 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:52:35.719421 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd77c07596e8b4a0ca52441af7cf96210'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.726653 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd77c07596e8b4a0ca52441af7cf96210'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.727689 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd77c07596e8b4a0ca52441af7cf96210'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.733083 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:35.742922 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd77c07596e8b4a0ca52441af7cf96210'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.751587 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.notifications [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd77c07596e8b4a0ca52441af7cf96210'} {{(pid=88407) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:35.757902 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 527/1044] 10.222.0.39 () {58 vars in 1224 bytes} [Sat Oct 22 20:52:35 2022] DELETE /identity/v3/users/d77c07596e8b4a0ca52441af7cf96210 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:52:36.172645 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] Authenticating user token {{(pid=88408) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:52:36.174210 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.fernet_utils [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88408) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:52:36.188837 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df01ebda-fda2-4daa-bf49-e5b94dfe7da8 admin admin] Validating token access rules against request {{(pid=88408) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:52:36.247185 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f2fce337ce4a417ea9044d0fbc87d49f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9729266775c4452a92f26be4932200ad', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88408) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:52:36.247843 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:52:36.248121 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:52:36.248391 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] PATH_INFO: `/v3/projects/c6bc3798385a4b85a0a35d9dad669937` {{(pid=88408) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:52:36.249522 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6bc3798385a4b85a0a35d9dad669937)` {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:52:36.251469 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] RBAC: Authorization granted {{(pid=88408) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:52:36.301658 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6bc3798385a4b85a0a35d9dad669937', 'request_id': 'req-66ae97c7-da2e-4b38-9313-2fbf2e344df2'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:36.310901 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6bc3798385a4b85a0a35d9dad669937', 'request_id': 'req-66ae97c7-da2e-4b38-9313-2fbf2e344df2'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:36.316526 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6bc3798385a4b85a0a35d9dad669937', 'request_id': 'req-66ae97c7-da2e-4b38-9313-2fbf2e344df2'} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:36.327974 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] The token cache is being invalidate because project c6bc3798385a4b85a0a35d9dad669937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=88408) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Oct 22 20:52:36.328236 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:36.328920 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG keystone.notifications [None req-66ae97c7-da2e-4b38-9313-2fbf2e344df2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=88408) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Oct 22 20:52:36.330672 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: [pid: 88408|app: 0|req: 518/1045] 10.222.0.39 () {58 vars in 1233 bytes} [Sat Oct 22 20:52:36 2022] DELETE /identity/v3/projects/c6bc3798385a4b85a0a35d9dad669937 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Oct 22 20:52:45.754436 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=6,keystone:DELETE=2,keystone:INSERT=1 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:52:46.324932 dv-osbrick-master-4-ceph devstack@keystone.service[88408]: DEBUG dbcounter [-] [88408] Writing DB stats keystone:SELECT=53,keystone:DELETE=7,keystone:INSERT=1 {{(pid=88408) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 22 20:56:12.942836 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] Authenticating user token {{(pid=88407) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Oct 22 20:56:12.944492 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:56:13.037026 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9944c503-0b97-4feb-8cf4-cb7f505d69fa admin admin] Validating token access rules against request {{(pid=88407) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Oct 22 20:56:13.099790 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e78008-9c92-44cb-9680-674675b626c9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9b73c8f104d7476294921098cec0a8bf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '994d024676c1425fa15492ab23e267fd', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=88407) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Oct 22 20:56:13.100391 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e78008-9c92-44cb-9680-674675b626c9 service placement] REQUEST_METHOD: `GET` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Oct 22 20:56:13.100666 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e78008-9c92-44cb-9680-674675b626c9 service placement] SCRIPT_NAME: `/identity` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Oct 22 20:56:13.100929 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e78008-9c92-44cb-9680-674675b626c9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=88407) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Oct 22 20:56:13.103364 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.fernet_utils [None req-05e78008-9c92-44cb-9680-674675b626c9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=88407) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Oct 22 20:56:13.115048 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e78008-9c92-44cb-9680-674675b626c9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Oct 22 20:56:13.116658 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e78008-9c92-44cb-9680-674675b626c9 service placement] RBAC: Authorization granted {{(pid=88407) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Oct 22 20:56:13.126305 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: [pid: 88407|app: 0|req: 528/1046] 10.222.0.39 () {60 vars in 1365 bytes} [Sat Oct 22 20:56:12 2022] GET /identity/v3/auth/tokens => generated 2868 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Oct 22 20:56:23.122577 dv-osbrick-master-4-ceph devstack@keystone.service[88407]: DEBUG dbcounter [-] [88407] Writing DB stats keystone:SELECT=67 {{(pid=88407) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}